diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/state_c1024_t1p45_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/state_c1024_t1p45_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..742ac71235d3fda1fd3df685641e979b361d617f --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/state_c1024_t1p45_detok_raw_samples.txt @@ -0,0 +1,228 @@ +state_c1024_t1p45_detok +{ + "type": "summary", + "name": "state_c1024_t1p45", + "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", + "step": 124000, + "decode": { + "kind": "categorical_fullvocab", + "config": "state_c1024_t1p45", + "steps": 256, + "model_t_mode": "post", + "support_power": 1.0, + "semantic_power": 1.0, + "endpoint_temp": 1.45, + "concentration_min": 1.0, + "concentration_max": 1024.0, + "final_from": "state", + "update": "resample", + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 28.415282971033125, + "nll_per_token": 3.3469271332084953, + "tokens": 9529 + }, + "diversity": { + "sample_entropy": 4.048794239038511, + "unique_tokens": 1473, + "token_count": 8192, + "distinct_1": 0.1798095703125, + "distinct_2": 0.5878444881889764, + "top_token_mass": 0.057861328125 + } +} + +===== sample 000 ===== +[CLS] of their excesses. [SEP] "and there was so little space in it and a little bit of what went on in it. [SEP]" i just haven't asked him. [SEP] my fear is simply that the government has done so much to resolve their problems. [SEP] dallas took the lead just 2 minutes 26 seconds into the second period. [SEP] "he has a lot," he said. [SEP] cleveland trailed again at 8: 31 of the third quarter, when james hit a 20 - footer to take a 50 - 52 lead. [SEP] according to the report, the investigation is continuing. [SEP] i prefer not to mention the [SEP] + +===== sample 001 ===== +[CLS] 2008. [SEP] james baker, one of khao's top advisors, said he believed that the president understood that the plant should be closed and that he would review the project. [SEP] "i knew my heart and i felt like i was wrong, but he wanted me to do it and i had to make a right decision against him. [SEP] but yes, i'm in a quiet room in my office. [SEP]" some of these measures, such as safety - related measures, road safety and network rail transport, need to be done on a much greater scale, " the letter said. [SEP] he said that the government [SEP] + +===== sample 002 ===== +[CLS]'s ministry of defense. [SEP] "i felt we had to achieve that goal because they had that sense of perspective," he said. [SEP] total revenue for the full year 2009 expected to decrease by approximately $1, 000. $100 million for half of 2009 to $50 million for the remainder of 2009. [SEP] "even if they don't come to sleep, they have to stay away," safira says. [SEP] when he really does, i suspect he's not enough. [SEP] "i feel that i will never be able to move to the end of life," she said. [SEP] this is [SEP] + +===== sample 003 ===== +[CLS] pressure - - he will keep coming back at this point. [SEP] "instead, he doesn't like the system, doesn't like the one that took him back to the back of the house. [SEP]" unfortunately, we can't give a man much money. " [SEP] i don't think that it would be so easy. [SEP] but not yet, you can find out there. [SEP] it's hard to tell what is coming or where he is, when he's looking at the site. [SEP] tmz's wife chris, 28, has been married for more than 20 years. [SEP] i [SEP] + +===== sample 004 ===== +[CLS] in the area. [SEP] "we continue to do it in a private way, so i would love to stay in it. [SEP] the bbc writer will remain free until monday. [SEP] general manager joe girardi will make his move to atlanta with the new york jets. [SEP] i'm not sure what to do. [SEP] no, he's trying to take his advantage, not his luck. [SEP] for now, congress is getting a little harder on the company. [SEP] i thought i could have done it a bit. [SEP]" i am not sorry, but god knows, this is something that makes him so good. [SEP] [SEP] + +===== sample 005 ===== +[CLS] crime. [SEP] it's an acute situation that, in turn, happens when one is out of the job. [SEP] chris bosh had two players each with 11 points, calvin harris had three turnovers, and carlos boozer scored two apiece for the jazz, losers for the first time in the first five games of the season. [SEP] i hope they won't. [SEP] i think it's a joke, but they don't tell me how much it costs. [SEP] i hope i can't say it's because you're the child, and if you had known my father, i would have [SEP] + +===== sample 006 ===== +[CLS] 3 percent in the third quarter, unchanged from april, from 6. 5 percent in the previous quarter. [SEP] during the boom, cars in housing were still more expensive than the summer of 2007, and us food prices went up for the worst month in their history. [SEP] the cause of the fire, he did not want to be identified. [SEP] i'm really excited about it - - i know what i can do, "hecht said. [SEP]" he has a lot of goals, an average of eight games, and we cannot know yet whether he will be allowed to be in the finals, " he said. [SEP] [SEP] + +===== sample 007 ===== +[CLS] to expand that facility. [SEP] "if you want a player who wants to play, there's no way down the line. [SEP] and, maybe, they've got to stay in the dark and try to pay attention to the plight of a man who hates everything. [SEP]" in light of the current crisis, no political solution is prepared to demonstrate the u. s. commitment to deal with the challenges of the process, " clinton said during a visit to dubai. [SEP] in august, the house passed its own health care bill, which cost more than $1. 4 billion between 2009 and 2010. [SEP] i have heard [SEP] + +===== sample 008 ===== +[CLS] big questions about the scope of her story. [SEP] i'm not sure what you wrote about that. [SEP] the c. e. a. has a structure that is no different than the structure of the new regulator. [SEP] "we don't have time to think more on the issue, something we have got to do to save our economy. [SEP]" for me, i've always had a struggle with cancer in my life, " he said. [SEP] the farc should get no immediate response. [SEP] if the brakes are pressed, you will stand on top of the back of the 300 - seat commuter train. [SEP] [SEP] + +===== sample 009 ===== +[CLS] due to sign the deal, the jets are about to finish a two - game slide. [SEP] and there has not been any word on the money that will flow to the fund in 2010. [SEP] in addition to co - worker's court fees, he appeared to have been speaking with the defendant after the accident, he said. [SEP] the group, led by the hedge fund tycoon, has pledged more than $7m (£5. 7m). [SEP] and in the end, after it's years of work, i see it. [SEP] " don't be afraid to deal with the environment, let alone [SEP] + +===== sample 010 ===== +[CLS] of chicago.... [SEP] they are close to zero. [SEP] which is a shame, but i can also say, what we've got on the subject is so much campaign - related to the president. [SEP] so did the election of stupak's predecessor, representative harriet harman. [SEP] the journalist's release was a coup for the american journalists foundation, a los angeles - based organization. [SEP] the case, however, might have little to do with well - written and well - funded work. [SEP] " i was happy i didn't know exactly where i want to be from. [SEP] in 1996, [SEP] + +===== sample 011 ===== +[CLS]. [SEP] mr thompson said he did not expect "convincing evidence" to support the claims, but not much was changed. [SEP] and that is why it is so important. [SEP] it wouldn't be a nice thing to do but just get on a plane for a good day. [SEP] "i think the americans have moved on to their right. [SEP] it was an incredible experience, but when i don't get given the opportunity to live in the hands of the world, i would be willing to do that," he said. [SEP] it turns out that he can barely afford to have a black watch on his head. [SEP] [SEP] + +===== sample 012 ===== +[CLS] of up to some 6, 000 jobs. [SEP] it's just a lot of work, no idea. [SEP] chief fire officer john williams, of middlesbrough, said there was no need for an investigation into the incident. [SEP] the application has not been changed yet, but the date of appeal, which has been delayed until saturday, as the application has not been awarded so far, has been announced. [SEP] the person who did not want to be identified. [SEP] the hotel has a security staff, accompanied by a number of non - security staff, is due to close the doors after the weekend. [SEP] we have stood on top of [SEP] + +===== sample 013 ===== +[CLS] to recession, the us economy would face the worst economic recession in the world in two decades. [SEP] the company also acknowledged that the false statement was misleading to investors, and that some of the allegations are true. [SEP] after the hearing, she left a note with marks on his head saying he doesn't speak. [SEP] you can do it better. [SEP] the number was equal to 2. 5 million jobs in 2009. [SEP] at the end of the iraq war, most of the militants were fighting for u. s. forces in afghanistan. [SEP] "what we had to do was deal with this," ms martin added. [SEP] [SEP] + +===== sample 014 ===== +[CLS] do anything for our team to do with our performance, "he said. [SEP] no matter how hard we work to find the job, they put us in the best we can't. [SEP] if you live in your own financial system, you can't make too much of it. [SEP] not surprisingly, the team has struggled to keep up with washington's eighth - inning success. [SEP] small businesses get about $3 billion a year in emergency emergency loans. [SEP] he had only scored four runs in the series, including three of four games in the series, including one in the eighth. [SEP]" the incident is a huge [SEP] + +===== sample 015 ===== +[CLS] no danger to their aircraft. [SEP] "in the case of a point here, it would seem like we could pull this out, but when we do it a bit, then it can really get even a little easier," he said. [SEP] the study, based on computer data, was also conducted by paul gordon of new york university. [SEP] i knew that i wanted to be happy, i just wanted to sit down at the end of the day. [SEP] i'm confident that if i really feel i'm going to get fired, that would be a good thing then, " he said. [SEP] so, perhaps, [SEP] + +===== sample 016 ===== +[CLS], it's all drug - free. [SEP] he said: he's been under constant pressure for many years, but he has little time on tour, has already made some mistakes in international training and he has a lot to do. [SEP] the man took off in the area as the aircraft dropped off and went to police to face treatment. [SEP] "the conference will give the most powerful signal to the security of the palestinian state, and signal the president's commitment to maintain the security of the west bank," said an official at the state department. [SEP] it is supported by the fact that millions of people have access to [SEP] + +===== sample 017 ===== +[CLS] the number of visitors. [SEP] "we have had a great year," he said. [SEP] we are ready for them. [SEP] but there is no reason to doubt that. [SEP] all the way, you're right. [SEP] that's part of the problem. [SEP] "i think, at least, we believe that there was any kind of information," the official declared, "but nobody knows that." [SEP] the economy was an important contribution to obama's reform plans during the bush administration. [SEP] the site was built over the past year. [SEP] we are running out of the question of what happens to the political [SEP] + +===== sample 018 ===== +[CLS] relief. [SEP] i'll just look into her. [SEP] "i don't have that question. [SEP] make it before we can even make it to school. [SEP]" we knew we would all need our help and then we knew, "the statement said. [SEP]" it's disappointing, "he said. [SEP] mr brown also thinks he may have to pay his bills at the conference. [SEP] but i think it does have a lot of positive energy and makes you feel pretty good about doing those things. [SEP] a little odd to me. [SEP] however, in his speech, he said," i don't think [SEP] + +===== sample 019 ===== +[CLS] gmt. [SEP] the average price of single - or single - family homes in california is expected to rise by 50 percent in the next 12 months. [SEP] at the moment, we don't have much room or even an extra room. [SEP] the literary pleasures of a book to read - - books, such as "an evening, a day," and a bunch of "cookbooks" - - are the theme of the nation's literary traditions. [SEP] " none of the lawyers involved at the high court have been suspended. [SEP] but it's a shame, and it's not too bad for one of us [SEP] + +===== sample 020 ===== +[CLS] 2009. [SEP] then he explains that he did not have the position on his hands. [SEP] standing at the back of the audience, he appeared to have a large, airy, cartoon - like look. [SEP] on the other side, clinton, 66, put together a large bunch of bread and a piece. [SEP] the person who made the announcement had no intention of leaving at the time and signing a deal, people familiar with the negotiations said. [SEP] he has little mobility and is able to walk for 15 minutes, and his son is only six years old. [SEP] the average amount of a home will be about $1, 000 [SEP] + +===== sample 021 ===== +[CLS] 2010. [SEP] the entire us economy has slipped into a state of recession. [SEP] the fact is that greer, the french - born author of the sex drive, is no longer willing to look elsewhere to see his work and his resumes. [SEP] you can buy a number of things that are bigger - than - life. [SEP] mr brown said the move was a "very important partnership" for ssp, a uk - based organisation, which has become a household name. [SEP] "we just have to get really serious, it sort of all is wrong, but we want to get something better," he said. [SEP] the company [SEP] + +===== sample 022 ===== +[CLS] of his departure from the competition, the paper added. [SEP] they never made it to us and that means we have never got the best of the world. [SEP] sure, he hit the head and swiveled it off the track, but the 40 - year old got away from the field and fought back. [SEP] the attack took place in the sunni region of east baghdad. [SEP] "it's time to try to balance the puzzle and put my hands together, i'll be in a position to go," he said. [SEP] he's also trying to prove that he's got his hand in afghanistan. [SEP] [SEP] + +===== sample 023 ===== +[CLS] take place in the aug. [SEP] "they need to get in touch with their children because it is their school, their family," dr clasley says. [SEP] " i had a lot of money to set up but it didn't mean that i can't buy. [SEP] there is one reason to avoid strawberry wambar, the tomato - flavored dessert flavored with butter - like chocolate. [SEP] the dems, if not democrats, make an easy effort to explain themselves, not themselves. [SEP] during their three - year term, the company developed a number of small and high - energy power products in the [SEP] + +===== sample 024 ===== +[CLS] want to get access to education. [SEP] it is part of the city's 100 - year - old communal tradition. [SEP] mr. stauer was able to fill in the interview, which he did, even when he was 13, with one of her children, who had to do with her job, but didn't have the money to do it in public. [SEP] "i don't want anything in your car," she said. [SEP] normally, i only knew if i wanted to know if things would go wrong, but that would do a lot of work. [SEP] bp, the world's largest operator [SEP] + +===== sample 025 ===== +[CLS] see it, " he said. [SEP] that is when i don't like to be at a club. [SEP] yet, no one wanted to change their mind. [SEP] in addition, there will be a chance to bring democracy to haiti. [SEP] the problem, of course, is that unless the last one in the greek mythology is solved, suddenly it looks like something might have happened. [SEP] the man, who is unconscious, left the scene and left in a waiting car. [SEP] but that's not news. [SEP] i don't want to... [SEP] this is more of a new start, expected to take about [SEP] + +===== sample 026 ===== +[CLS] price of $50. [SEP] if you had weapons, communications, equipment, water, education, nothing would come out of them. [SEP] "i don't think you want to do that but if we get off better we play very well. [SEP] on september 11, 2003, the ranger's helicopter went down on the ground. [SEP] so far, markets have taken a bit of action in recent days. [SEP] he said the company does not report earnings in the near term. [SEP]" i can't tell you why he ended up for the presidency - - but i have had a lot of conversation, " he says. [SEP] + +===== sample 027 ===== +[CLS] really close to trying to get your foot back in the office. [SEP] i believe that my son can do, i just think we do what we need. [SEP] the ruling must be returned to the court on wednesday. [SEP] "it's a lot that's still a problem," he said. [SEP] if you bought a bike and thought it was a good idea, what would any of us have to do then? [SEP] i don't have to have a love thing, " she said. [SEP] however, it does not seem appropriate that the old boys seemed to reject it. [SEP] dr michael jordan, the doctor who [SEP] + +===== sample 028 ===== +[CLS] 2. 06 percent. [SEP] retail sales for the six months to january are 0. 7 per cent higher than in the year to march, according to official figures from the aa. [SEP] then he got to buy everything he knew - - and began to take his clothes at home - - and even put in one of his own - - in the back of the building, just to know something he had done. [SEP] so that is the right point. [SEP] the red wings took control in the opening period with 9 minutes left late into the third. [SEP] there will also need to be a better atmosphere at the club. [SEP] however, [SEP] + +===== sample 029 ===== +[CLS], simmons 0 - 0 - 1 0 - 0, bell 0 - 5 0 - 0 0 - 0 0 0 - 0 2, mobley 5 - 11, thomas 5 - 16, chicago 1 - 4. [SEP] the report, which is the first project to be released by the company, told the times it has become possible for more people to get in touch with their children rather than simply getting to the site. [SEP] " it feels like i'm going to die. [SEP] sales in june rose 11. 4 per cent to $100, 000. [SEP] irvine, calif. - if you know what's going [SEP] + +===== sample 030 ===== +[CLS] the end, to the end, and we have to get to the end of the story. [SEP] however, he spent part of a decade working for a provincial government, and in 2007 he worked in several companies. [SEP] the former president praised brawn's selection of hamilton, an eight - time world champion and a 13 - time champion, to win the four - man team in beijing. [SEP] but what we need to do is sit back and get a look of the place. [SEP] that's not to say that, if you're willing to go along with your bill, take a break. [SEP] however, they [SEP] + +===== sample 031 ===== +[CLS] hands disappeared into the air. [SEP] the nets led 50 - 50 with 1 minutes left in the opening period less than two minutes into the half. [SEP] when you think about the characters, you feel very old. [SEP] the s & p 500 was down 0. 5 percent, but the new york - based nasdaq composite index lost 0. 6 percent to 2, 724. 80. [SEP] but this was a gain of a little more than. 9 percent in december, with the market already at the top of the agenda. [SEP] "we lived for 80 years, so we're there," he said. [SEP] [SEP] + +===== sample 032 ===== +[CLS] bush's top diplomat, said at a news briefing held on the morning of july 11 that the afghan government, with support from us and other international forces, should not try to face the possibility of a real arms race. [SEP] i think he's a very good player... [SEP] "obviously, if we thought we'd never have been, there was something we can do to have one, we have, but we have one, we will stay out, we will come in," said davis, who was among nine staffers - - all of them who lost their own seat. [SEP] he refused to answer [SEP] + +===== sample 033 ===== +[CLS], 000 school children were among the 70, 000 people affected by the earthquake. [SEP] he allowed only two runs in 4 1/3 - 2 3/3 innings and one walk for the tigers. [SEP] i don't like to talk about the marriage. [SEP] american officials have also warned that there will be a "significant risk" if the u. s. continues to pursue a military effort against al - qaida. [SEP] but the burdens, however, can only be applied to the public face of what has been a structural imbalance in their economies and other rich nations. [SEP] it's even more complicated, [SEP] + +===== sample 034 ===== +[CLS] do not believe there is any evidence that the security agreement in iraq has been ended. [SEP] since obama has promised to end all the civil rights, if not necessary, it would be an attempt to start a democratic campaign to end this process. [SEP] the idea is to place large pots of corn in the crooks of a road, in place of branches, cars and trees. [SEP] like me, however, i feel a little more confident, if with a little look and a little smile. [SEP] an estimated 4. 5 million people are homeless. [SEP] "i'm trying to finish," he said. [SEP] he also wants [SEP] + +===== sample 035 ===== +[CLS] rose to 28. 5 % for the year from 26. 3 % a year ago. [SEP] the only option for a second vaccine is to check the safety and health effects of the vaccine. [SEP] a 33 - year - old nigerian man, charged with resisting police bail, jumped onto the air force's flight to the united states. [SEP] i hope that someone will make it out there and take them to the game, " he said. [SEP] also at the same time, spain's new defense minister, carlos borges, also said he would ask the european union to increase military force in afghanistan. [SEP] the e - mail [SEP] + +===== sample 036 ===== +[CLS] of the detainees, but said he had no idea of them. [SEP] "when we realized he was still five miles away, we thought he was right in the air and it was great to walk," said james molinaro, a 38 - year - old campaign office manager. [SEP] in the end, everything is dead. [SEP] "i have to sacrifice my patience to get things done. [SEP] when i run into a couple of things, i'd like to be realistic. [SEP]" we'll look at a state level to have a much greater understanding of what an individual is in the workplace. [SEP] that's when [SEP] + +===== sample 037 ===== +[CLS] said. [SEP] "it would normally have been an act of money, but sometimes it is just really simple," he said. [SEP] "no one is not going to get involved," he said. [SEP] i've been doing it since the start of the season and, had i been there for a while, it usually became a very long trip. [SEP] "you cannot feel the pressure. [SEP]" if there is a guy that is going to be a lot of pressure, i will not make any changes, " he said. [SEP] there are other assets that could be useful to investors in the long run. [SEP] the [SEP] + +===== sample 038 ===== +[CLS] two other us service personnel were killed in a helicopter bomb crash in afghanistan. [SEP] "you can see how we do things. [SEP] it is good to think it's important to understand that there's something written in that - - and try to get some feedback on it. [SEP] that is our thought for a couple of months. [SEP]" i don't want to see what is changed. [SEP] together, they're lovely and sexy, it's more realistic and romantic. [SEP] " i never had anyone in the national team, i never had a taste for it. [SEP] so, i understand. [SEP] and if [SEP] + +===== sample 039 ===== +[CLS] in january 2010. [SEP] his identity was confirmed by his prison guards before he was returned to the prison, where he was held there in october 2002. [SEP] "it is not when you talk, when you look for a joke," he said. [SEP] i thought i went too far. [SEP] but he said that there would be a five - year deal with germany, an end to the war in afghanistan, as well as iran. [SEP] i think most of the iranian people would have been able to turn their country into a democracy. [SEP] the president's vacation needs to last for a week or two. [SEP] she moved her [SEP] + +===== sample 040 ===== +[CLS]'s up to them. [SEP] i'm not going to apologize, i don't like what the law says. [SEP] you never see it again, " he said. [SEP] he's no regrets, and no regrets, but he also seems to have to go through a couple of problems at the end of the game. [SEP] he's a nice guy and with a good balance and able to get things started. [SEP] but we have to work hard in the n. f. c. at all to be one of those who don't really want to lose - - they're kind of going to keep [SEP] + +===== sample 041 ===== +[CLS] in the case of the state, he said. [SEP] it is posted on the website and is only 56 % true. [SEP] but i wanted to get home. [SEP] the plant has an additional 1, 200 manufacturing capacity and is more than 5, 000 square miles (3, 300), he said. [SEP] in fact, the floor is full for you, and at this moment, it's all in the shape of the second floor, and when you see the room at the door, there's no living room, no chairs, or bedroom. [SEP] the british military will resume its regular exercise with a technical training centre [SEP] + +===== sample 042 ===== +[CLS] to spend much of the day. [SEP] "i've never done any of my tests and i know when he is going to play south africa i don't think that that is something i really want to do again," said wester. [SEP] it is that if there has to be a person living in the city - - it is like the end of a political year. [SEP] a spokesman for doug hoffman, a davis' lawyer, said he had told the jury that the attack was of public safety and that he did not have the right to take action in the court. [SEP] i don't think a real estate [SEP] + +===== sample 043 ===== +[CLS] agenda. [SEP] mr. cohen returned to europe to run the company in a further few years. [SEP] it's possible, in the general sense, that we have to put on a show of, well, something that has a history, i'd love to have a chance to show that, to do something in a bit of context. [SEP] he added that, among other things, the uk could become more able to deal with long - term problems. [SEP] the north has begun making new travel plans to allow aid and entry to the border, and also has ordered a full end of access to the buffer zone. [SEP] the [SEP] + +===== sample 044 ===== +[CLS] he was wearing brown jeans and armed with a white shirt, an coloured jacket and a white tie. [SEP] he said: "he has never had a lot of money. [SEP] that's a big thing. [SEP]" i have to say the last three years, you are following one of the many things that have come on in the last 10 years. [SEP] the real deal is insurance. [SEP] that's what they can do. [SEP] that isn't what we want, he says. [SEP] the team knows that he will be able to take part at milan, but he is always on the road. [SEP] in a conference [SEP] + +===== sample 045 ===== +[CLS] insurers. [SEP] i spoke to her right outside. [SEP] "so we're going to get in a little more than a little bit," he said. [SEP] "it is a game that we don't know in the past, yet we all have a respect for the players. [SEP] he has described his attacker as a" little henger. "[SEP] i dished out and he seemed to be able to make his way. [SEP]" it's been a quarter of a century, " she said. [SEP] the government has announced the release of tens of thousands of police, police and intelligence workers, from [SEP] + +===== sample 046 ===== +[CLS] said. [SEP] if you are successful, you will have to be careful before the end of the season. [SEP] the man is in custody and police are trying to get any further information. [SEP] he even looked as if the answer was a complete lack of effort. [SEP] but mr. brown said the question of this needed to be addressed. [SEP] the bank suffered $3. 4 billion in losses in the first quarter of fiscal 2008. [SEP] the entire site is supposed to be close to capacity. [SEP] after all, he said, most of the staff and crew would be allowed to come back in full by march. [SEP] " the truth [SEP] + +===== sample 047 ===== +[CLS] he worked out the layout of his wife's home, a one - bedroom apartment in seattle, he wrote. [SEP] "when i get to work, that's good. [SEP] it's strange he was in trouble, but at least he wanted to know how he felt when he was seeing himself on television, he said. [SEP] a number of sources said the council had no regrets. [SEP] it was a big step, according to lacker. [SEP]" it's going to be the last of the season, it's a matter of time, " he said. [SEP] i do not think we're trying [SEP] + +===== sample 048 ===== +[CLS] 000 troops. [SEP] british police would not comment on the incident. [SEP] he and his brother and sister were all released tuesday. [SEP] crude oil prices in the first six months of the year hit a record high of $65bn, up 14 per cent to $25. 4bn (£17. 7bn), on better - than - expected figures from oil and mining companies. [SEP] the house's bill also provides banks up to $2, 000 for loans, including loans and interest payments made to the fha. [SEP] but the figure's figure climbed to 7 per cent from 3. 7 million. [SEP] there [SEP] + +===== sample 049 ===== +[CLS] system, and the market is able to turn to mark - to - market capital growth. "[SEP]" if we were to win, we would have to get there, we have to go to win, and we would have to do whatever we could do, we would not do that, "mullen said. [SEP] it's good enough to take pride in life. [SEP]" it'd be nice to be taken up in the end, "nadal said. [SEP]" i do remember him. [SEP] as a result, a patient has to learn about how to talk to people. [SEP] in a statement, the organization [SEP] + +===== sample 050 ===== +[CLS] in chicago, has worked for several years at the university of maryland. [SEP] "of course, we have taken some steps to get out of the situation, we have to take it through, to get it done, right. [SEP]" every time i really have to do something, it's hard when i'm going to be in line for another year, "he told reporters after heading into the locker room. [SEP]" i came back in time and said, and she said, ' i've got got to do this, i wanted to play, and i wasn't really interested. [SEP] we're already [SEP] + +===== sample 051 ===== +[CLS] way to ensure that the end - of - life information on the web site has not been used, the post reported. [SEP] (21 - 22): you may be able to pay you off, especially when you do want to travel one way and pay off all the money on the holidays. [SEP] i have always wondered here about why people are going to be there. [SEP] the issue of land and water, the world's most sought - after area of long - term development, was resolved in a little less than a week. [SEP] one of the injured was a school teacher in peshawar, about 50 miles from the airport. [SEP] + +===== sample 052 ===== +[CLS] percent in the second quarter, is still looking to add the $3, 700 billion cut from the tarp program to the additional $50 billion in additional guarantees it would provide to help stabilize the financial system over the next year. [SEP] wilco had his first full game, leaving his left glove behind on the mound. [SEP] c £40, 000 (+ £36, 702). central london. £35, 000 - £30, 703 ( luling up to £39, 092 per annum. £32, 071 - 1. we are looking for a permanent b.... [SEP] " [SEP] + +===== sample 053 ===== +[CLS], those who live here have to live with their families, "he said. [SEP]" i don't think he should go to manchester because i'm sure he'd like to come back. [SEP] live in the pain of having to do what is required, "she said. [SEP] but the current human condition facing the tigers is not clear. [SEP]" if you stop the damage, the money is going to go around, you know. [SEP] what we've seen is a general improvement, "said mr corsi. [SEP] i'm not too sure," mr. catt said. [SEP] during the [SEP] + +===== sample 054 ===== +[CLS], then drove off for a walk and left at 2: 45 a. m., according to police at the scene. [SEP] beijing (reuters) - china's tough relations with dalai lama and beijing met again on monday to resolve a long - running dispute that has sparked growing tensions with china, according to u. s. officials. [SEP] " it's about money, it's about people when you're in people's control, trying to understand what people they are, giving them time and money, which means you want to do what you want to know to do.... [SEP] the difference is [SEP] + +===== sample 055 ===== +[CLS] to the polls. [SEP] "the choice for you is not to stick to any solution but to review matters now, to talk directly to the prime minister, the foreign minister," said britain's prime minister gordon brown. [SEP] "there's a question, we're going to say, ' if we are really prepared for this, we'll have an election, that's fine," daube said. [SEP] "we have not stopped, we have no plans," he said. [SEP] when he came to the project, he changed his mind, but promised that it would provide a little more space [SEP] + +===== sample 056 ===== +[CLS]. [SEP] i mean, i can spend too much time with him on our backs next year, but i wish i had just finished my first year, i'm sure we can get that too much attention. [SEP] he, however, was not in the audience. [SEP] but, that doesn't mean it's worth saying to me, that i know i want to do something about it, that i want to make an impact. [SEP] by the end of the week, all of us have returned to our vacation homes. [SEP] but for some of them, this kind of action must have seemed long ago. [SEP] the lack [SEP] + +===== sample 057 ===== +[CLS]m loss for the firm, which had revenue of £19, 000. [SEP] he's a very good person, " mr brown said. [SEP] well, i think it was a good idea. [SEP] we don't want to do anything about the greatness of life, but we do have to make a decision. [SEP] a combined total of more than 500, 000 sodas were sold, including more than 2, 000 to consumers in 2007, according to steve mellow, general manager of the beverage industry association. [SEP] the deal also includes two activities - - the gym, the golf club, the dining area, and [SEP] + +===== sample 058 ===== +[CLS] of rising debt into the economy. [SEP] however, that was brought to the attention. [SEP] the market then was down. [SEP] look at how you could get to see a lot of people reading stories and people here to read them. [SEP] it is not really what they want us to see. [SEP] if it comes back, i won't be looking out. [SEP] i just hope that all of this should be corrected. [SEP] don't expect them to tell me to do anything, as i always have to say here, but of course, i'm trying to tell you that it all happened in the united states. [SEP] [SEP] + +===== sample 059 ===== +[CLS] flights will be made from new york, the u. s. and canada. [SEP] it's a way to give you a break, a way to play, "biden said. [SEP]" i think for a lot of people, there's a problem, "he said. [SEP] we'd have to win. [SEP] he was mostly out of games in recent seasons, and he seemed to make quite a few hits. [SEP] his mother was unable to get to the hospital. [SEP]" there has been tremendous change in the team since the end of the year. [SEP] " i'm just saying these things when i [SEP] + +===== sample 060 ===== +[CLS] in the air. [SEP] it's not a game to plan, it's a "game of good communication." [SEP] as a result, ba faced the prospect of trying to take control of the group in case of a bankruptcy. [SEP] if an immediate decision is made, like the vote to strike in december, they would be able to do so. [SEP] they have never been in a room with family members, and they have a film and a documentary, a lot of movies, "she said. [SEP]" i saw the woman at the end of the flight on a curtain call. [SEP] that's right, " [SEP] + +===== sample 061 ===== +[CLS] i could care for him. [SEP] "i've got a career as a doctor, so it doesn't work for me anymore, it's not a good one," eno said. [SEP] i was happy for him. [SEP] if i want to become a science teacher, i have to do a few things, "rahm told reporters. [SEP]" we are unable to confirm the report to the committee and expect to give evidence to the full council later in march, and are working to get the further action forward, " the statement said. [SEP] in the second round of the conference title, the cavaliers won their [SEP] + +===== sample 062 ===== +[CLS].. fl. training - education is assigned to oversee........ and other activities related to this program. are immediately available to assist.... de.. in coordinating with international organizations, corporations and other.... mn. 08/07:/hh ( and many of you currently have.... in... il, paris, ct, and washington, dc. someone needs to be responsible for a position able to lead.... co. access to education, degree of experience... ct, level of experience to be a teacher or.. [SEP] + +===== sample 063 ===== +[CLS] the area. [SEP] "it increases the brain's ability to communicate," buffon said. [SEP] he's done that. [SEP] a person wants to look back at your eyes - - the eyes of a man - - but he gives up an outline of his mind every 15 minutes. [SEP] i have to remember how to take my time at the far end of things. [SEP] there is nothing more to this story in the spirit of adventure than the illusion of good quality. [SEP] look, they've only been a bit lower since the end of the year. [SEP] " we don't know how to go about it [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/state_c1024_t1p45_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/state_c1024_t1p45_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..7da12daafe9f2d6c2b4c59947148cddfa5e15e70 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/state_c1024_t1p45_raw_samples.txt @@ -0,0 +1,228 @@ +state_c1024_t1p45 +{ + "type": "summary", + "name": "state_c1024_t1p45", + "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", + "step": 124000, + "decode": { + "kind": "categorical_fullvocab", + "config": "state_c1024_t1p45", + "steps": 256, + "model_t_mode": "post", + "support_power": 1.0, + "semantic_power": 1.0, + "endpoint_temp": 1.45, + "concentration_min": 1.0, + "concentration_max": 1024.0, + "final_from": "state", + "update": "resample", + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 28.415282971033125, + "nll_per_token": 3.3469271332084953, + "tokens": 9529 + }, + "diversity": { + "sample_entropy": 4.048794239038511, + "unique_tokens": 1473, + "token_count": 8192, + "distinct_1": 0.1798095703125, + "distinct_2": 0.5878444881889764, + "top_token_mass": 0.057861328125 + } +} + +===== sample 000 ===== +[CLS] of their excesses. [SEP] " and there was so little space in it and a little bit of what went on in it. [SEP] " i just haven ' t asked him. [SEP] my fear is simply that the government has done so much to resolve their problems. [SEP] dallas took the lead just 2 minutes 26 seconds into the second period. [SEP] " he has a lot, " he said. [SEP] cleveland trailed again at 8 : 31 of the third quarter, when james hit a 20 - footer to take a 50 - 52 lead. [SEP] according to the report, the investigation is continuing. [SEP] i prefer not to mention the [SEP] + +===== sample 001 ===== +[CLS] 2008. [SEP] james baker, one of khao ' s top advisors, said he believed that the president understood that the plant should be closed and that he would review the project. [SEP] " i knew my heart and i felt like i was wrong, but he wanted me to do it and i had to make a right decision against him. [SEP] but yes, i ' m in a quiet room in my office. [SEP] " some of these measures, such as safety - related measures, road safety and network rail transport, need to be done on a much greater scale, " the letter said. [SEP] he said that the government [SEP] + +===== sample 002 ===== +[CLS] ' s ministry of defense. [SEP] " i felt we had to achieve that goal because they had that sense of perspective, " he said. [SEP] total revenue for the full year 2009 expected to decrease by approximately $ 1, 000. $ 100 million for half of 2009 to $ 50 million for the remainder of 2009. [SEP] " even if they don ' t come to sleep, they have to stay away, " safira says. [SEP] when he really does, i suspect he ' s not enough. [SEP] " i feel that i will never be able to move to the end of life, " she said. [SEP] this is [SEP] + +===== sample 003 ===== +[CLS] pressure - - he will keep coming back at this point. [SEP] " instead, he doesn ' t like the system, doesn ' t like the one that took him back to the back of the house. [SEP] " unfortunately, we can ' t give a man much money. " [SEP] i don ' t think that it would be so easy. [SEP] but not yet, you can find out there. [SEP] it ' s hard to tell what is coming or where he is, when he ' s looking at the site. [SEP] tmz ' s wife chris, 28, has been married for more than 20 years. [SEP] i [SEP] + +===== sample 004 ===== +[CLS] in the area. [SEP] " we continue to do it in a private way, so i would love to stay in it. [SEP] the bbc writer will remain free until monday. [SEP] general manager joe girardi will make his move to atlanta with the new york jets. [SEP] i ' m not sure what to do. [SEP] no, he ' s trying to take his advantage, not his luck. [SEP] for now, congress is getting a little harder on the company. [SEP] i thought i could have done it a bit. [SEP] " i am not sorry, but god knows, this is something that makes him so good. [SEP] [SEP] + +===== sample 005 ===== +[CLS] crime. [SEP] it ' s an acute situation that, in turn, happens when one is out of the job. [SEP] chris bosh had two players each with 11 points, calvin harris had three turnovers, and carlos boozer scored two apiece for the jazz, losers for the first time in the first five games of the season. [SEP] i hope they won ' t. [SEP] i think it ' s a joke, but they don ' t tell me how much it costs. [SEP] i hope i can ' t say it ' s because you ' re the child, and if you had known my father, i would have [SEP] + +===== sample 006 ===== +[CLS] 3 percent in the third quarter, unchanged from april, from 6. 5 percent in the previous quarter. [SEP] during the boom, cars in housing were still more expensive than the summer of 2007, and us food prices went up for the worst month in their history. [SEP] the cause of the fire, he did not want to be identified. [SEP] i ' m really excited about it - - i know what i can do, " hecht said. [SEP] " he has a lot of goals, an average of eight games, and we cannot know yet whether he will be allowed to be in the finals, " he said. [SEP] [SEP] + +===== sample 007 ===== +[CLS] to expand that facility. [SEP] " if you want a player who wants to play, there ' s no way down the line. [SEP] and, maybe, they ' ve got to stay in the dark and try to pay attention to the plight of a man who hates everything. [SEP] " in light of the current crisis, no political solution is prepared to demonstrate the u. s. commitment to deal with the challenges of the process, " clinton said during a visit to dubai. [SEP] in august, the house passed its own health care bill, which cost more than $ 1. 4 billion between 2009 and 2010. [SEP] i have heard [SEP] + +===== sample 008 ===== +[CLS] big questions about the scope of her story. [SEP] i ' m not sure what you wrote about that. [SEP] the c. e. a. has a structure that is no different than the structure of the new regulator. [SEP] " we don ' t have time to think more on the issue, something we have got to do to save our economy. [SEP] " for me, i ' ve always had a struggle with cancer in my life, " he said. [SEP] the farc should get no immediate response. [SEP] if the brakes are pressed, you will stand on top of the back of the 300 - seat commuter train. [SEP] [SEP] + +===== sample 009 ===== +[CLS] due to sign the deal, the jets are about to finish a two - game slide. [SEP] and there has not been any word on the money that will flow to the fund in 2010. [SEP] in addition to co - worker ' s court fees, he appeared to have been speaking with the defendant after the accident, he said. [SEP] the group, led by the hedge fund tycoon, has pledged more than $ 7m ( £5. 7m ). [SEP] and in the end, after it ' s years of work, i see it. [SEP] " don ' t be afraid to deal with the environment, let alone [SEP] + +===== sample 010 ===== +[CLS] of chicago.... [SEP] they are close to zero. [SEP] which is a shame, but i can also say, what we ' ve got on the subject is so much campaign - related to the president. [SEP] so did the election of stupak ' s predecessor, representative harriet harman. [SEP] the journalist ' s release was a coup for the american journalists foundation, a los angeles - based organization. [SEP] the case, however, might have little to do with well - written and well - funded work. [SEP] " i was happy i didn ' t know exactly where i want to be from. [SEP] in 1996, [SEP] + +===== sample 011 ===== +[CLS]. [SEP] mr thompson said he did not expect " convincing evidence " to support the claims, but not much was changed. [SEP] and that is why it is so important. [SEP] it wouldn ' t be a nice thing to do but just get on a plane for a good day. [SEP] " i think the americans have moved on to their right. [SEP] it was an incredible experience, but when i don ' t get given the opportunity to live in the hands of the world, i would be willing to do that, " he said. [SEP] it turns out that he can barely afford to have a black watch on his head. [SEP] [SEP] + +===== sample 012 ===== +[CLS] of up to some 6, 000 jobs. [SEP] it ' s just a lot of work, no idea. [SEP] chief fire officer john williams, of middlesbrough, said there was no need for an investigation into the incident. [SEP] the application has not been changed yet, but the date of appeal, which has been delayed until saturday, as the application has not been awarded so far, has been announced. [SEP] the person who did not want to be identified. [SEP] the hotel has a security staff, accompanied by a number of non - security staff, is due to close the doors after the weekend. [SEP] we have stood on top of [SEP] + +===== sample 013 ===== +[CLS] to recession, the us economy would face the worst economic recession in the world in two decades. [SEP] the company also acknowledged that the false statement was misleading to investors, and that some of the allegations are true. [SEP] after the hearing, she left a note with marks on his head saying he doesn ' t speak. [SEP] you can do it better. [SEP] the number was equal to 2. 5 million jobs in 2009. [SEP] at the end of the iraq war, most of the militants were fighting for u. s. forces in afghanistan. [SEP] " what we had to do was deal with this, " ms martin added. [SEP] [SEP] + +===== sample 014 ===== +[CLS] do anything for our team to do with our performance, " he said. [SEP] no matter how hard we work to find the job, they put us in the best we can ' t. [SEP] if you live in your own financial system, you can ' t make too much of it. [SEP] not surprisingly, the team has struggled to keep up with washington ' s eighth - inning success. [SEP] small businesses get about $ 3 billion a year in emergency emergency loans. [SEP] he had only scored four runs in the series, including three of four games in the series, including one in the eighth. [SEP] " the incident is a huge [SEP] + +===== sample 015 ===== +[CLS] no danger to their aircraft. [SEP] " in the case of a point here, it would seem like we could pull this out, but when we do it a bit, then it can really get even a little easier, " he said. [SEP] the study, based on computer data, was also conducted by paul gordon of new york university. [SEP] i knew that i wanted to be happy, i just wanted to sit down at the end of the day. [SEP] i ' m confident that if i really feel i ' m going to get fired, that would be a good thing then, " he said. [SEP] so, perhaps, [SEP] + +===== sample 016 ===== +[CLS], it ' s all drug - free. [SEP] he said : he ' s been under constant pressure for many years, but he has little time on tour, has already made some mistakes in international training and he has a lot to do. [SEP] the man took off in the area as the aircraft dropped off and went to police to face treatment. [SEP] " the conference will give the most powerful signal to the security of the palestinian state, and signal the president ' s commitment to maintain the security of the west bank, " said an official at the state department. [SEP] it is supported by the fact that millions of people have access to [SEP] + +===== sample 017 ===== +[CLS] the number of visitors. [SEP] " we have had a great year, " he said. [SEP] we are ready for them. [SEP] but there is no reason to doubt that. [SEP] all the way, you ' re right. [SEP] that ' s part of the problem. [SEP] " i think, at least, we believe that there was any kind of information, " the official declared, " but nobody knows that. " [SEP] the economy was an important contribution to obama ' s reform plans during the bush administration. [SEP] the site was built over the past year. [SEP] we are running out of the question of what happens to the political [SEP] + +===== sample 018 ===== +[CLS] relief. [SEP] i ' ll just look into her. [SEP] " i don ' t have that question. [SEP] make it before we can even make it to school. [SEP] " we knew we would all need our help and then we knew, " the statement said. [SEP] " it ' s disappointing, " he said. [SEP] mr brown also thinks he may have to pay his bills at the conference. [SEP] but i think it does have a lot of positive energy and makes you feel pretty good about doing those things. [SEP] a little odd to me. [SEP] however, in his speech, he said, " i don ' t think [SEP] + +===== sample 019 ===== +[CLS] gmt. [SEP] the average price of single - or single - family homes in california is expected to rise by 50 percent in the next 12 months. [SEP] at the moment, we don ' t have much room or even an extra room. [SEP] the literary pleasures of a book to read - - books, such as " an evening, a day, " and a bunch of " cookbooks " - - are the theme of the nation ' s literary traditions. [SEP] " none of the lawyers involved at the high court have been suspended. [SEP] but it ' s a shame, and it ' s not too bad for one of us [SEP] + +===== sample 020 ===== +[CLS] 2009. [SEP] then he explains that he did not have the position on his hands. [SEP] standing at the back of the audience, he appeared to have a large, airy, cartoon - like look. [SEP] on the other side, clinton, 66, put together a large bunch of bread and a piece. [SEP] the person who made the announcement had no intention of leaving at the time and signing a deal, people familiar with the negotiations said. [SEP] he has little mobility and is able to walk for 15 minutes, and his son is only six years old. [SEP] the average amount of a home will be about $ 1, 000 [SEP] + +===== sample 021 ===== +[CLS] 2010. [SEP] the entire us economy has slipped into a state of recession. [SEP] the fact is that greer, the french - born author of the sex drive, is no longer willing to look elsewhere to see his work and his resumes. [SEP] you can buy a number of things that are bigger - than - life. [SEP] mr brown said the move was a " very important partnership " for ssp, a uk - based organisation, which has become a household name. [SEP] " we just have to get really serious, it sort of all is wrong, but we want to get something better, " he said. [SEP] the company [SEP] + +===== sample 022 ===== +[CLS] of his departure from the competition, the paper added. [SEP] they never made it to us and that means we have never got the best of the world. [SEP] sure, he hit the head and swiveled it off the track, but the 40 - year old got away from the field and fought back. [SEP] the attack took place in the sunni region of east baghdad. [SEP] " it ' s time to try to balance the puzzle and put my hands together, i ' ll be in a position to go, " he said. [SEP] he ' s also trying to prove that he ' s got his hand in afghanistan. [SEP] [SEP] + +===== sample 023 ===== +[CLS] take place in the aug. [SEP] " they need to get in touch with their children because it is their school, their family, " dr clasley says. [SEP] " i had a lot of money to set up but it didn ' t mean that i can ' t buy. [SEP] there is one reason to avoid strawberry wambar, the tomato - flavored dessert flavored with butter - like chocolate. [SEP] the dems, if not democrats, make an easy effort to explain themselves, not themselves. [SEP] during their three - year term, the company developed a number of small and high - energy power products in the [SEP] + +===== sample 024 ===== +[CLS] want to get access to education. [SEP] it is part of the city ' s 100 - year - old communal tradition. [SEP] mr. stauer was able to fill in the interview, which he did, even when he was 13, with one of her children, who had to do with her job, but didn ' t have the money to do it in public. [SEP] " i don ' t want anything in your car, " she said. [SEP] normally, i only knew if i wanted to know if things would go wrong, but that would do a lot of work. [SEP] bp, the world ' s largest operator [SEP] + +===== sample 025 ===== +[CLS] see it, " he said. [SEP] that is when i don ' t like to be at a club. [SEP] yet, no one wanted to change their mind. [SEP] in addition, there will be a chance to bring democracy to haiti. [SEP] the problem, of course, is that unless the last one in the greek mythology is solved, suddenly it looks like something might have happened. [SEP] the man, who is unconscious, left the scene and left in a waiting car. [SEP] but that ' s not news. [SEP] i don ' t want to... [SEP] this is more of a new start, expected to take about [SEP] + +===== sample 026 ===== +[CLS] price of $ 50. [SEP] if you had weapons, communications, equipment, water, education, nothing would come out of them. [SEP] " i don ' t think you want to do that but if we get off better we play very well. [SEP] on september 11, 2003, the ranger ' s helicopter went down on the ground. [SEP] so far, markets have taken a bit of action in recent days. [SEP] he said the company does not report earnings in the near term. [SEP] " i can ' t tell you why he ended up for the presidency - - but i have had a lot of conversation, " he says. [SEP] + +===== sample 027 ===== +[CLS] really close to trying to get your foot back in the office. [SEP] i believe that my son can do, i just think we do what we need. [SEP] the ruling must be returned to the court on wednesday. [SEP] " it ' s a lot that ' s still a problem, " he said. [SEP] if you bought a bike and thought it was a good idea, what would any of us have to do then? [SEP] i don ' t have to have a love thing, " she said. [SEP] however, it does not seem appropriate that the old boys seemed to reject it. [SEP] dr michael jordan, the doctor who [SEP] + +===== sample 028 ===== +[CLS] 2. 06 percent. [SEP] retail sales for the six months to january are 0. 7 per cent higher than in the year to march, according to official figures from the aa. [SEP] then he got to buy everything he knew - - and began to take his clothes at home - - and even put in one of his own - - in the back of the building, just to know something he had done. [SEP] so that is the right point. [SEP] the red wings took control in the opening period with 9 minutes left late into the third. [SEP] there will also need to be a better atmosphere at the club. [SEP] however, [SEP] + +===== sample 029 ===== +[CLS], simmons 0 - 0 - 1 0 - 0, bell 0 - 5 0 - 0 0 - 0 0 0 - 0 2, mobley 5 - 11, thomas 5 - 16, chicago 1 - 4. [SEP] the report, which is the first project to be released by the company, told the times it has become possible for more people to get in touch with their children rather than simply getting to the site. [SEP] " it feels like i ' m going to die. [SEP] sales in june rose 11. 4 per cent to $ 100, 000. [SEP] irvine, calif. - if you know what ' s going [SEP] + +===== sample 030 ===== +[CLS] the end, to the end, and we have to get to the end of the story. [SEP] however, he spent part of a decade working for a provincial government, and in 2007 he worked in several companies. [SEP] the former president praised brawn ' s selection of hamilton, an eight - time world champion and a 13 - time champion, to win the four - man team in beijing. [SEP] but what we need to do is sit back and get a look of the place. [SEP] that ' s not to say that, if you ' re willing to go along with your bill, take a break. [SEP] however, they [SEP] + +===== sample 031 ===== +[CLS] hands disappeared into the air. [SEP] the nets led 50 - 50 with 1 minutes left in the opening period less than two minutes into the half. [SEP] when you think about the characters, you feel very old. [SEP] the s & p 500 was down 0. 5 percent, but the new york - based nasdaq composite index lost 0. 6 percent to 2, 724. 80. [SEP] but this was a gain of a little more than. 9 percent in december, with the market already at the top of the agenda. [SEP] " we lived for 80 years, so we ' re there, " he said. [SEP] [SEP] + +===== sample 032 ===== +[CLS] bush ' s top diplomat, said at a news briefing held on the morning of july 11 that the afghan government, with support from us and other international forces, should not try to face the possibility of a real arms race. [SEP] i think he ' s a very good player... [SEP] " obviously, if we thought we ' d never have been, there was something we can do to have one, we have, but we have one, we will stay out, we will come in, " said davis, who was among nine staffers - - all of them who lost their own seat. [SEP] he refused to answer [SEP] + +===== sample 033 ===== +[CLS], 000 school children were among the 70, 000 people affected by the earthquake. [SEP] he allowed only two runs in 4 1 / 3 - 2 3 / 3 innings and one walk for the tigers. [SEP] i don ' t like to talk about the marriage. [SEP] american officials have also warned that there will be a " significant risk " if the u. s. continues to pursue a military effort against al - qaida. [SEP] but the burdens, however, can only be applied to the public face of what has been a structural imbalance in their economies and other rich nations. [SEP] it ' s even more complicated, [SEP] + +===== sample 034 ===== +[CLS] do not believe there is any evidence that the security agreement in iraq has been ended. [SEP] since obama has promised to end all the civil rights, if not necessary, it would be an attempt to start a democratic campaign to end this process. [SEP] the idea is to place large pots of corn in the crooks of a road, in place of branches, cars and trees. [SEP] like me, however, i feel a little more confident, if with a little look and a little smile. [SEP] an estimated 4. 5 million people are homeless. [SEP] " i ' m trying to finish, " he said. [SEP] he also wants [SEP] + +===== sample 035 ===== +[CLS] rose to 28. 5 % for the year from 26. 3 % a year ago. [SEP] the only option for a second vaccine is to check the safety and health effects of the vaccine. [SEP] a 33 - year - old nigerian man, charged with resisting police bail, jumped onto the air force ' s flight to the united states. [SEP] i hope that someone will make it out there and take them to the game, " he said. [SEP] also at the same time, spain ' s new defense minister, carlos borges, also said he would ask the european union to increase military force in afghanistan. [SEP] the e - mail [SEP] + +===== sample 036 ===== +[CLS] of the detainees, but said he had no idea of them. [SEP] " when we realized he was still five miles away, we thought he was right in the air and it was great to walk, " said james molinaro, a 38 - year - old campaign office manager. [SEP] in the end, everything is dead. [SEP] " i have to sacrifice my patience to get things done. [SEP] when i run into a couple of things, i ' d like to be realistic. [SEP] " we ' ll look at a state level to have a much greater understanding of what an individual is in the workplace. [SEP] that ' s when [SEP] + +===== sample 037 ===== +[CLS] said. [SEP] " it would normally have been an act of money, but sometimes it is just really simple, " he said. [SEP] " no one is not going to get involved, " he said. [SEP] i ' ve been doing it since the start of the season and, had i been there for a while, it usually became a very long trip. [SEP] " you cannot feel the pressure. [SEP] " if there is a guy that is going to be a lot of pressure, i will not make any changes, " he said. [SEP] there are other assets that could be useful to investors in the long run. [SEP] the [SEP] + +===== sample 038 ===== +[CLS] two other us service personnel were killed in a helicopter bomb crash in afghanistan. [SEP] " you can see how we do things. [SEP] it is good to think it ' s important to understand that there ' s something written in that - - and try to get some feedback on it. [SEP] that is our thought for a couple of months. [SEP] " i don ' t want to see what is changed. [SEP] together, they ' re lovely and sexy, it ' s more realistic and romantic. [SEP] " i never had anyone in the national team, i never had a taste for it. [SEP] so, i understand. [SEP] and if [SEP] + +===== sample 039 ===== +[CLS] in january 2010. [SEP] his identity was confirmed by his prison guards before he was returned to the prison, where he was held there in october 2002. [SEP] " it is not when you talk, when you look for a joke, " he said. [SEP] i thought i went too far. [SEP] but he said that there would be a five - year deal with germany, an end to the war in afghanistan, as well as iran. [SEP] i think most of the iranian people would have been able to turn their country into a democracy. [SEP] the president ' s vacation needs to last for a week or two. [SEP] she moved her [SEP] + +===== sample 040 ===== +[CLS] ' s up to them. [SEP] i ' m not going to apologize, i don ' t like what the law says. [SEP] you never see it again, " he said. [SEP] he ' s no regrets, and no regrets, but he also seems to have to go through a couple of problems at the end of the game. [SEP] he ' s a nice guy and with a good balance and able to get things started. [SEP] but we have to work hard in the n. f. c. at all to be one of those who don ' t really want to lose - - they ' re kind of going to keep [SEP] + +===== sample 041 ===== +[CLS] in the case of the state, he said. [SEP] it is posted on the website and is only 56 % true. [SEP] but i wanted to get home. [SEP] the plant has an additional 1, 200 manufacturing capacity and is more than 5, 000 square miles ( 3, 300 ), he said. [SEP] in fact, the floor is full for you, and at this moment, it ' s all in the shape of the second floor, and when you see the room at the door, there ' s no living room, no chairs, or bedroom. [SEP] the british military will resume its regular exercise with a technical training centre [SEP] + +===== sample 042 ===== +[CLS] to spend much of the day. [SEP] " i ' ve never done any of my tests and i know when he is going to play south africa i don ' t think that that is something i really want to do again, " said wester. [SEP] it is that if there has to be a person living in the city - - it is like the end of a political year. [SEP] a spokesman for doug hoffman, a davis ' lawyer, said he had told the jury that the attack was of public safety and that he did not have the right to take action in the court. [SEP] i don ' t think a real estate [SEP] + +===== sample 043 ===== +[CLS] agenda. [SEP] mr. cohen returned to europe to run the company in a further few years. [SEP] it ' s possible, in the general sense, that we have to put on a show of, well, something that has a history, i ' d love to have a chance to show that, to do something in a bit of context. [SEP] he added that, among other things, the uk could become more able to deal with long - term problems. [SEP] the north has begun making new travel plans to allow aid and entry to the border, and also has ordered a full end of access to the buffer zone. [SEP] the [SEP] + +===== sample 044 ===== +[CLS] he was wearing brown jeans and armed with a white shirt, an coloured jacket and a white tie. [SEP] he said : " he has never had a lot of money. [SEP] that ' s a big thing. [SEP] " i have to say the last three years, you are following one of the many things that have come on in the last 10 years. [SEP] the real deal is insurance. [SEP] that ' s what they can do. [SEP] that isn ' t what we want, he says. [SEP] the team knows that he will be able to take part at milan, but he is always on the road. [SEP] in a conference [SEP] + +===== sample 045 ===== +[CLS] insurers. [SEP] i spoke to her right outside. [SEP] " so we ' re going to get in a little more than a little bit, " he said. [SEP] " it is a game that we don ' t know in the past, yet we all have a respect for the players. [SEP] he has described his attacker as a " little henger. " [SEP] i dished out and he seemed to be able to make his way. [SEP] " it ' s been a quarter of a century, " she said. [SEP] the government has announced the release of tens of thousands of police, police and intelligence workers, from [SEP] + +===== sample 046 ===== +[CLS] said. [SEP] if you are successful, you will have to be careful before the end of the season. [SEP] the man is in custody and police are trying to get any further information. [SEP] he even looked as if the answer was a complete lack of effort. [SEP] but mr. brown said the question of this needed to be addressed. [SEP] the bank suffered $ 3. 4 billion in losses in the first quarter of fiscal 2008. [SEP] the entire site is supposed to be close to capacity. [SEP] after all, he said, most of the staff and crew would be allowed to come back in full by march. [SEP] " the truth [SEP] + +===== sample 047 ===== +[CLS] he worked out the layout of his wife ' s home, a one - bedroom apartment in seattle, he wrote. [SEP] " when i get to work, that ' s good. [SEP] it ' s strange he was in trouble, but at least he wanted to know how he felt when he was seeing himself on television, he said. [SEP] a number of sources said the council had no regrets. [SEP] it was a big step, according to lacker. [SEP] " it ' s going to be the last of the season, it ' s a matter of time, " he said. [SEP] i do not think we ' re trying [SEP] + +===== sample 048 ===== +[CLS] 000 troops. [SEP] british police would not comment on the incident. [SEP] he and his brother and sister were all released tuesday. [SEP] crude oil prices in the first six months of the year hit a record high of $ 65bn, up 14 per cent to $ 25. 4bn ( £17. 7bn ), on better - than - expected figures from oil and mining companies. [SEP] the house ' s bill also provides banks up to $ 2, 000 for loans, including loans and interest payments made to the fha. [SEP] but the figure ' s figure climbed to 7 per cent from 3. 7 million. [SEP] there [SEP] + +===== sample 049 ===== +[CLS] system, and the market is able to turn to mark - to - market capital growth. " [SEP] " if we were to win, we would have to get there, we have to go to win, and we would have to do whatever we could do, we would not do that, " mullen said. [SEP] it ' s good enough to take pride in life. [SEP] " it ' d be nice to be taken up in the end, " nadal said. [SEP] " i do remember him. [SEP] as a result, a patient has to learn about how to talk to people. [SEP] in a statement, the organization [SEP] + +===== sample 050 ===== +[CLS] in chicago, has worked for several years at the university of maryland. [SEP] " of course, we have taken some steps to get out of the situation, we have to take it through, to get it done, right. [SEP] " every time i really have to do something, it ' s hard when i ' m going to be in line for another year, " he told reporters after heading into the locker room. [SEP] " i came back in time and said, and she said, ' i ' ve got got to do this, i wanted to play, and i wasn ' t really interested. [SEP] we ' re already [SEP] + +===== sample 051 ===== +[CLS] way to ensure that the end - of - life information on the web site has not been used, the post reported. [SEP] ( 21 - 22 ) : you may be able to pay you off, especially when you do want to travel one way and pay off all the money on the holidays. [SEP] i have always wondered here about why people are going to be there. [SEP] the issue of land and water, the world ' s most sought - after area of long - term development, was resolved in a little less than a week. [SEP] one of the injured was a school teacher in peshawar, about 50 miles from the airport. [SEP] + +===== sample 052 ===== +[CLS] percent in the second quarter, is still looking to add the $ 3, 700 billion cut from the tarp program to the additional $ 50 billion in additional guarantees it would provide to help stabilize the financial system over the next year. [SEP] wilco had his first full game, leaving his left glove behind on the mound. [SEP] c £40, 000 ( + £36, 702 ). central london. £35, 000 - £30, 703 ( luling up to £39, 092 per annum. £32, 071 - 1. we are looking for a permanent b.... [SEP] " [SEP] + +===== sample 053 ===== +[CLS], those who live here have to live with their families, " he said. [SEP] " i don ' t think he should go to manchester because i ' m sure he ' d like to come back. [SEP] live in the pain of having to do what is required, " she said. [SEP] but the current human condition facing the tigers is not clear. [SEP] " if you stop the damage, the money is going to go around, you know. [SEP] what we ' ve seen is a general improvement, " said mr corsi. [SEP] i ' m not too sure, " mr. catt said. [SEP] during the [SEP] + +===== sample 054 ===== +[CLS], then drove off for a walk and left at 2 : 45 a. m., according to police at the scene. [SEP] beijing ( reuters ) - china ' s tough relations with dalai lama and beijing met again on monday to resolve a long - running dispute that has sparked growing tensions with china, according to u. s. officials. [SEP] " it ' s about money, it ' s about people when you ' re in people ' s control, trying to understand what people they are, giving them time and money, which means you want to do what you want to know to do.... [SEP] the difference is [SEP] + +===== sample 055 ===== +[CLS] to the polls. [SEP] " the choice for you is not to stick to any solution but to review matters now, to talk directly to the prime minister, the foreign minister, " said britain ' s prime minister gordon brown. [SEP] " there ' s a question, we ' re going to say, ' if we are really prepared for this, we ' ll have an election, that ' s fine, " daube said. [SEP] " we have not stopped, we have no plans, " he said. [SEP] when he came to the project, he changed his mind, but promised that it would provide a little more space [SEP] + +===== sample 056 ===== +[CLS]. [SEP] i mean, i can spend too much time with him on our backs next year, but i wish i had just finished my first year, i ' m sure we can get that too much attention. [SEP] he, however, was not in the audience. [SEP] but, that doesn ' t mean it ' s worth saying to me, that i know i want to do something about it, that i want to make an impact. [SEP] by the end of the week, all of us have returned to our vacation homes. [SEP] but for some of them, this kind of action must have seemed long ago. [SEP] the lack [SEP] + +===== sample 057 ===== +[CLS]m loss for the firm, which had revenue of £19, 000. [SEP] he ' s a very good person, " mr brown said. [SEP] well, i think it was a good idea. [SEP] we don ' t want to do anything about the greatness of life, but we do have to make a decision. [SEP] a combined total of more than 500, 000 sodas were sold, including more than 2, 000 to consumers in 2007, according to steve mellow, general manager of the beverage industry association. [SEP] the deal also includes two activities - - the gym, the golf club, the dining area, and [SEP] + +===== sample 058 ===== +[CLS] of rising debt into the economy. [SEP] however, that was brought to the attention. [SEP] the market then was down. [SEP] look at how you could get to see a lot of people reading stories and people here to read them. [SEP] it is not really what they want us to see. [SEP] if it comes back, i won ' t be looking out. [SEP] i just hope that all of this should be corrected. [SEP] don ' t expect them to tell me to do anything, as i always have to say here, but of course, i ' m trying to tell you that it all happened in the united states. [SEP] [SEP] + +===== sample 059 ===== +[CLS] flights will be made from new york, the u. s. and canada. [SEP] it ' s a way to give you a break, a way to play, " biden said. [SEP] " i think for a lot of people, there ' s a problem, " he said. [SEP] we ' d have to win. [SEP] he was mostly out of games in recent seasons, and he seemed to make quite a few hits. [SEP] his mother was unable to get to the hospital. [SEP] " there has been tremendous change in the team since the end of the year. [SEP] " i ' m just saying these things when i [SEP] + +===== sample 060 ===== +[CLS] in the air. [SEP] it ' s not a game to plan, it ' s a " game of good communication. " [SEP] as a result, ba faced the prospect of trying to take control of the group in case of a bankruptcy. [SEP] if an immediate decision is made, like the vote to strike in december, they would be able to do so. [SEP] they have never been in a room with family members, and they have a film and a documentary, a lot of movies, " she said. [SEP] " i saw the woman at the end of the flight on a curtain call. [SEP] that ' s right, " [SEP] + +===== sample 061 ===== +[CLS] i could care for him. [SEP] " i ' ve got a career as a doctor, so it doesn ' t work for me anymore, it ' s not a good one, " eno said. [SEP] i was happy for him. [SEP] if i want to become a science teacher, i have to do a few things, " rahm told reporters. [SEP] " we are unable to confirm the report to the committee and expect to give evidence to the full council later in march, and are working to get the further action forward, " the statement said. [SEP] in the second round of the conference title, the cavaliers won their [SEP] + +===== sample 062 ===== +[CLS].. fl. training - education is assigned to oversee........ and other activities related to this program. are immediately available to assist.... de.. in coordinating with international organizations, corporations and other.... mn. 08 / 07 : / hh ( and many of you currently have.... in... il, paris, ct, and washington, dc. someone needs to be responsible for a position able to lead.... co. access to education, degree of experience... ct, level of experience to be a teacher or.. [SEP] + +===== sample 063 ===== +[CLS] the area. [SEP] " it increases the brain ' s ability to communicate, " buffon said. [SEP] he ' s done that. [SEP] a person wants to look back at your eyes - - the eyes of a man - - but he gives up an outline of his mind every 15 minutes. [SEP] i have to remember how to take my time at the far end of things. [SEP] there is nothing more to this story in the spirit of adventure than the illusion of good quality. [SEP] look, they ' ve only been a bit lower since the end of the year. [SEP] " we don ' t know how to go about it [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/state_c1024_t1p45_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/state_c1024_t1p45_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..0561538f0ff0ced1a7dce406113353e89c3ca9a6 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/state_c1024_t1p45_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "state_c1024_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c1024_t1p45", "steps": 256, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 28.415282971033125, "nll_per_token": 3.3469271332084953, "tokens": 9529}, "diversity": {"sample_entropy": 4.048794239038511, "unique_tokens": 1473, "token_count": 8192, "distinct_1": 0.1798095703125, "distinct_2": 0.5878444881889764, "top_token_mass": 0.057861328125}} +{"type": "sample", "index": 0, "raw_text": "[CLS] of their excesses. [SEP] \" and there was so little space in it and a little bit of what went on in it. [SEP] \" i just haven ' t asked him. [SEP] my fear is simply that the government has done so much to resolve their problems. [SEP] dallas took the lead just 2 minutes 26 seconds into the second period. [SEP] \" he has a lot, \" he said. [SEP] cleveland trailed again at 8 : 31 of the third quarter, when james hit a 20 - footer to take a 50 - 52 lead. [SEP] according to the report, the investigation is continuing. [SEP] i prefer not to mention the [SEP]", "detok_text": "[CLS] of their excesses. [SEP] \"and there was so little space in it and a little bit of what went on in it. [SEP]\" i just haven't asked him. [SEP] my fear is simply that the government has done so much to resolve their problems. [SEP] dallas took the lead just 2 minutes 26 seconds into the second period. [SEP] \"he has a lot,\" he said. [SEP] cleveland trailed again at 8: 31 of the third quarter, when james hit a 20 - footer to take a 50 - 52 lead. [SEP] according to the report, the investigation is continuing. [SEP] i prefer not to mention the [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] 2008. [SEP] james baker, one of khao ' s top advisors, said he believed that the president understood that the plant should be closed and that he would review the project. [SEP] \" i knew my heart and i felt like i was wrong, but he wanted me to do it and i had to make a right decision against him. [SEP] but yes, i ' m in a quiet room in my office. [SEP] \" some of these measures, such as safety - related measures, road safety and network rail transport, need to be done on a much greater scale, \" the letter said. [SEP] he said that the government [SEP]", "detok_text": "[CLS] 2008. [SEP] james baker, one of khao's top advisors, said he believed that the president understood that the plant should be closed and that he would review the project. [SEP] \"i knew my heart and i felt like i was wrong, but he wanted me to do it and i had to make a right decision against him. [SEP] but yes, i'm in a quiet room in my office. [SEP]\" some of these measures, such as safety - related measures, road safety and network rail transport, need to be done on a much greater scale, \" the letter said. [SEP] he said that the government [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] ' s ministry of defense. [SEP] \" i felt we had to achieve that goal because they had that sense of perspective, \" he said. [SEP] total revenue for the full year 2009 expected to decrease by approximately $ 1, 000. $ 100 million for half of 2009 to $ 50 million for the remainder of 2009. [SEP] \" even if they don ' t come to sleep, they have to stay away, \" safira says. [SEP] when he really does, i suspect he ' s not enough. [SEP] \" i feel that i will never be able to move to the end of life, \" she said. [SEP] this is [SEP]", "detok_text": "[CLS]'s ministry of defense. [SEP] \"i felt we had to achieve that goal because they had that sense of perspective,\" he said. [SEP] total revenue for the full year 2009 expected to decrease by approximately $1, 000. $100 million for half of 2009 to $50 million for the remainder of 2009. [SEP] \"even if they don't come to sleep, they have to stay away,\" safira says. [SEP] when he really does, i suspect he's not enough. [SEP] \"i feel that i will never be able to move to the end of life,\" she said. [SEP] this is [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS] pressure - - he will keep coming back at this point. [SEP] \" instead, he doesn ' t like the system, doesn ' t like the one that took him back to the back of the house. [SEP] \" unfortunately, we can ' t give a man much money. \" [SEP] i don ' t think that it would be so easy. [SEP] but not yet, you can find out there. [SEP] it ' s hard to tell what is coming or where he is, when he ' s looking at the site. [SEP] tmz ' s wife chris, 28, has been married for more than 20 years. [SEP] i [SEP]", "detok_text": "[CLS] pressure - - he will keep coming back at this point. [SEP] \"instead, he doesn't like the system, doesn't like the one that took him back to the back of the house. [SEP]\" unfortunately, we can't give a man much money. \" [SEP] i don't think that it would be so easy. [SEP] but not yet, you can find out there. [SEP] it's hard to tell what is coming or where he is, when he's looking at the site. [SEP] tmz's wife chris, 28, has been married for more than 20 years. [SEP] i [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] in the area. [SEP] \" we continue to do it in a private way, so i would love to stay in it. [SEP] the bbc writer will remain free until monday. [SEP] general manager joe girardi will make his move to atlanta with the new york jets. [SEP] i ' m not sure what to do. [SEP] no, he ' s trying to take his advantage, not his luck. [SEP] for now, congress is getting a little harder on the company. [SEP] i thought i could have done it a bit. [SEP] \" i am not sorry, but god knows, this is something that makes him so good. [SEP] [SEP]", "detok_text": "[CLS] in the area. [SEP] \"we continue to do it in a private way, so i would love to stay in it. [SEP] the bbc writer will remain free until monday. [SEP] general manager joe girardi will make his move to atlanta with the new york jets. [SEP] i'm not sure what to do. [SEP] no, he's trying to take his advantage, not his luck. [SEP] for now, congress is getting a little harder on the company. [SEP] i thought i could have done it a bit. [SEP]\" i am not sorry, but god knows, this is something that makes him so good. [SEP] [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] crime. [SEP] it ' s an acute situation that, in turn, happens when one is out of the job. [SEP] chris bosh had two players each with 11 points, calvin harris had three turnovers, and carlos boozer scored two apiece for the jazz, losers for the first time in the first five games of the season. [SEP] i hope they won ' t. [SEP] i think it ' s a joke, but they don ' t tell me how much it costs. [SEP] i hope i can ' t say it ' s because you ' re the child, and if you had known my father, i would have [SEP]", "detok_text": "[CLS] crime. [SEP] it's an acute situation that, in turn, happens when one is out of the job. [SEP] chris bosh had two players each with 11 points, calvin harris had three turnovers, and carlos boozer scored two apiece for the jazz, losers for the first time in the first five games of the season. [SEP] i hope they won't. [SEP] i think it's a joke, but they don't tell me how much it costs. [SEP] i hope i can't say it's because you're the child, and if you had known my father, i would have [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] 3 percent in the third quarter, unchanged from april, from 6. 5 percent in the previous quarter. [SEP] during the boom, cars in housing were still more expensive than the summer of 2007, and us food prices went up for the worst month in their history. [SEP] the cause of the fire, he did not want to be identified. [SEP] i ' m really excited about it - - i know what i can do, \" hecht said. [SEP] \" he has a lot of goals, an average of eight games, and we cannot know yet whether he will be allowed to be in the finals, \" he said. [SEP] [SEP]", "detok_text": "[CLS] 3 percent in the third quarter, unchanged from april, from 6. 5 percent in the previous quarter. [SEP] during the boom, cars in housing were still more expensive than the summer of 2007, and us food prices went up for the worst month in their history. [SEP] the cause of the fire, he did not want to be identified. [SEP] i'm really excited about it - - i know what i can do, \"hecht said. [SEP]\" he has a lot of goals, an average of eight games, and we cannot know yet whether he will be allowed to be in the finals, \" he said. [SEP] [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] to expand that facility. [SEP] \" if you want a player who wants to play, there ' s no way down the line. [SEP] and, maybe, they ' ve got to stay in the dark and try to pay attention to the plight of a man who hates everything. [SEP] \" in light of the current crisis, no political solution is prepared to demonstrate the u. s. commitment to deal with the challenges of the process, \" clinton said during a visit to dubai. [SEP] in august, the house passed its own health care bill, which cost more than $ 1. 4 billion between 2009 and 2010. [SEP] i have heard [SEP]", "detok_text": "[CLS] to expand that facility. [SEP] \"if you want a player who wants to play, there's no way down the line. [SEP] and, maybe, they've got to stay in the dark and try to pay attention to the plight of a man who hates everything. [SEP]\" in light of the current crisis, no political solution is prepared to demonstrate the u. s. commitment to deal with the challenges of the process, \" clinton said during a visit to dubai. [SEP] in august, the house passed its own health care bill, which cost more than $1. 4 billion between 2009 and 2010. [SEP] i have heard [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] big questions about the scope of her story. [SEP] i ' m not sure what you wrote about that. [SEP] the c. e. a. has a structure that is no different than the structure of the new regulator. [SEP] \" we don ' t have time to think more on the issue, something we have got to do to save our economy. [SEP] \" for me, i ' ve always had a struggle with cancer in my life, \" he said. [SEP] the farc should get no immediate response. [SEP] if the brakes are pressed, you will stand on top of the back of the 300 - seat commuter train. [SEP] [SEP]", "detok_text": "[CLS] big questions about the scope of her story. [SEP] i'm not sure what you wrote about that. [SEP] the c. e. a. has a structure that is no different than the structure of the new regulator. [SEP] \"we don't have time to think more on the issue, something we have got to do to save our economy. [SEP]\" for me, i've always had a struggle with cancer in my life, \" he said. [SEP] the farc should get no immediate response. [SEP] if the brakes are pressed, you will stand on top of the back of the 300 - seat commuter train. [SEP] [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] due to sign the deal, the jets are about to finish a two - game slide. [SEP] and there has not been any word on the money that will flow to the fund in 2010. [SEP] in addition to co - worker ' s court fees, he appeared to have been speaking with the defendant after the accident, he said. [SEP] the group, led by the hedge fund tycoon, has pledged more than $ 7m ( £5. 7m ). [SEP] and in the end, after it ' s years of work, i see it. [SEP] \" don ' t be afraid to deal with the environment, let alone [SEP]", "detok_text": "[CLS] due to sign the deal, the jets are about to finish a two - game slide. [SEP] and there has not been any word on the money that will flow to the fund in 2010. [SEP] in addition to co - worker's court fees, he appeared to have been speaking with the defendant after the accident, he said. [SEP] the group, led by the hedge fund tycoon, has pledged more than $7m (£5. 7m). [SEP] and in the end, after it's years of work, i see it. [SEP] \" don't be afraid to deal with the environment, let alone [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] of chicago.... [SEP] they are close to zero. [SEP] which is a shame, but i can also say, what we ' ve got on the subject is so much campaign - related to the president. [SEP] so did the election of stupak ' s predecessor, representative harriet harman. [SEP] the journalist ' s release was a coup for the american journalists foundation, a los angeles - based organization. [SEP] the case, however, might have little to do with well - written and well - funded work. [SEP] \" i was happy i didn ' t know exactly where i want to be from. [SEP] in 1996, [SEP]", "detok_text": "[CLS] of chicago.... [SEP] they are close to zero. [SEP] which is a shame, but i can also say, what we've got on the subject is so much campaign - related to the president. [SEP] so did the election of stupak's predecessor, representative harriet harman. [SEP] the journalist's release was a coup for the american journalists foundation, a los angeles - based organization. [SEP] the case, however, might have little to do with well - written and well - funded work. [SEP] \" i was happy i didn't know exactly where i want to be from. [SEP] in 1996, [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS]. [SEP] mr thompson said he did not expect \" convincing evidence \" to support the claims, but not much was changed. [SEP] and that is why it is so important. [SEP] it wouldn ' t be a nice thing to do but just get on a plane for a good day. [SEP] \" i think the americans have moved on to their right. [SEP] it was an incredible experience, but when i don ' t get given the opportunity to live in the hands of the world, i would be willing to do that, \" he said. [SEP] it turns out that he can barely afford to have a black watch on his head. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] mr thompson said he did not expect \"convincing evidence\" to support the claims, but not much was changed. [SEP] and that is why it is so important. [SEP] it wouldn't be a nice thing to do but just get on a plane for a good day. [SEP] \"i think the americans have moved on to their right. [SEP] it was an incredible experience, but when i don't get given the opportunity to live in the hands of the world, i would be willing to do that,\" he said. [SEP] it turns out that he can barely afford to have a black watch on his head. [SEP] [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS] of up to some 6, 000 jobs. [SEP] it ' s just a lot of work, no idea. [SEP] chief fire officer john williams, of middlesbrough, said there was no need for an investigation into the incident. [SEP] the application has not been changed yet, but the date of appeal, which has been delayed until saturday, as the application has not been awarded so far, has been announced. [SEP] the person who did not want to be identified. [SEP] the hotel has a security staff, accompanied by a number of non - security staff, is due to close the doors after the weekend. [SEP] we have stood on top of [SEP]", "detok_text": "[CLS] of up to some 6, 000 jobs. [SEP] it's just a lot of work, no idea. [SEP] chief fire officer john williams, of middlesbrough, said there was no need for an investigation into the incident. [SEP] the application has not been changed yet, but the date of appeal, which has been delayed until saturday, as the application has not been awarded so far, has been announced. [SEP] the person who did not want to be identified. [SEP] the hotel has a security staff, accompanied by a number of non - security staff, is due to close the doors after the weekend. [SEP] we have stood on top of [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS] to recession, the us economy would face the worst economic recession in the world in two decades. [SEP] the company also acknowledged that the false statement was misleading to investors, and that some of the allegations are true. [SEP] after the hearing, she left a note with marks on his head saying he doesn ' t speak. [SEP] you can do it better. [SEP] the number was equal to 2. 5 million jobs in 2009. [SEP] at the end of the iraq war, most of the militants were fighting for u. s. forces in afghanistan. [SEP] \" what we had to do was deal with this, \" ms martin added. [SEP] [SEP]", "detok_text": "[CLS] to recession, the us economy would face the worst economic recession in the world in two decades. [SEP] the company also acknowledged that the false statement was misleading to investors, and that some of the allegations are true. [SEP] after the hearing, she left a note with marks on his head saying he doesn't speak. [SEP] you can do it better. [SEP] the number was equal to 2. 5 million jobs in 2009. [SEP] at the end of the iraq war, most of the militants were fighting for u. s. forces in afghanistan. [SEP] \"what we had to do was deal with this,\" ms martin added. [SEP] [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] do anything for our team to do with our performance, \" he said. [SEP] no matter how hard we work to find the job, they put us in the best we can ' t. [SEP] if you live in your own financial system, you can ' t make too much of it. [SEP] not surprisingly, the team has struggled to keep up with washington ' s eighth - inning success. [SEP] small businesses get about $ 3 billion a year in emergency emergency loans. [SEP] he had only scored four runs in the series, including three of four games in the series, including one in the eighth. [SEP] \" the incident is a huge [SEP]", "detok_text": "[CLS] do anything for our team to do with our performance, \"he said. [SEP] no matter how hard we work to find the job, they put us in the best we can't. [SEP] if you live in your own financial system, you can't make too much of it. [SEP] not surprisingly, the team has struggled to keep up with washington's eighth - inning success. [SEP] small businesses get about $3 billion a year in emergency emergency loans. [SEP] he had only scored four runs in the series, including three of four games in the series, including one in the eighth. [SEP]\" the incident is a huge [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS] no danger to their aircraft. [SEP] \" in the case of a point here, it would seem like we could pull this out, but when we do it a bit, then it can really get even a little easier, \" he said. [SEP] the study, based on computer data, was also conducted by paul gordon of new york university. [SEP] i knew that i wanted to be happy, i just wanted to sit down at the end of the day. [SEP] i ' m confident that if i really feel i ' m going to get fired, that would be a good thing then, \" he said. [SEP] so, perhaps, [SEP]", "detok_text": "[CLS] no danger to their aircraft. [SEP] \"in the case of a point here, it would seem like we could pull this out, but when we do it a bit, then it can really get even a little easier,\" he said. [SEP] the study, based on computer data, was also conducted by paul gordon of new york university. [SEP] i knew that i wanted to be happy, i just wanted to sit down at the end of the day. [SEP] i'm confident that if i really feel i'm going to get fired, that would be a good thing then, \" he said. [SEP] so, perhaps, [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS], it ' s all drug - free. [SEP] he said : he ' s been under constant pressure for many years, but he has little time on tour, has already made some mistakes in international training and he has a lot to do. [SEP] the man took off in the area as the aircraft dropped off and went to police to face treatment. [SEP] \" the conference will give the most powerful signal to the security of the palestinian state, and signal the president ' s commitment to maintain the security of the west bank, \" said an official at the state department. [SEP] it is supported by the fact that millions of people have access to [SEP]", "detok_text": "[CLS], it's all drug - free. [SEP] he said: he's been under constant pressure for many years, but he has little time on tour, has already made some mistakes in international training and he has a lot to do. [SEP] the man took off in the area as the aircraft dropped off and went to police to face treatment. [SEP] \"the conference will give the most powerful signal to the security of the palestinian state, and signal the president's commitment to maintain the security of the west bank,\" said an official at the state department. [SEP] it is supported by the fact that millions of people have access to [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] the number of visitors. [SEP] \" we have had a great year, \" he said. [SEP] we are ready for them. [SEP] but there is no reason to doubt that. [SEP] all the way, you ' re right. [SEP] that ' s part of the problem. [SEP] \" i think, at least, we believe that there was any kind of information, \" the official declared, \" but nobody knows that. \" [SEP] the economy was an important contribution to obama ' s reform plans during the bush administration. [SEP] the site was built over the past year. [SEP] we are running out of the question of what happens to the political [SEP]", "detok_text": "[CLS] the number of visitors. [SEP] \"we have had a great year,\" he said. [SEP] we are ready for them. [SEP] but there is no reason to doubt that. [SEP] all the way, you're right. [SEP] that's part of the problem. [SEP] \"i think, at least, we believe that there was any kind of information,\" the official declared, \"but nobody knows that.\" [SEP] the economy was an important contribution to obama's reform plans during the bush administration. [SEP] the site was built over the past year. [SEP] we are running out of the question of what happens to the political [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS] relief. [SEP] i ' ll just look into her. [SEP] \" i don ' t have that question. [SEP] make it before we can even make it to school. [SEP] \" we knew we would all need our help and then we knew, \" the statement said. [SEP] \" it ' s disappointing, \" he said. [SEP] mr brown also thinks he may have to pay his bills at the conference. [SEP] but i think it does have a lot of positive energy and makes you feel pretty good about doing those things. [SEP] a little odd to me. [SEP] however, in his speech, he said, \" i don ' t think [SEP]", "detok_text": "[CLS] relief. [SEP] i'll just look into her. [SEP] \"i don't have that question. [SEP] make it before we can even make it to school. [SEP]\" we knew we would all need our help and then we knew, \"the statement said. [SEP]\" it's disappointing, \"he said. [SEP] mr brown also thinks he may have to pay his bills at the conference. [SEP] but i think it does have a lot of positive energy and makes you feel pretty good about doing those things. [SEP] a little odd to me. [SEP] however, in his speech, he said,\" i don't think [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] gmt. [SEP] the average price of single - or single - family homes in california is expected to rise by 50 percent in the next 12 months. [SEP] at the moment, we don ' t have much room or even an extra room. [SEP] the literary pleasures of a book to read - - books, such as \" an evening, a day, \" and a bunch of \" cookbooks \" - - are the theme of the nation ' s literary traditions. [SEP] \" none of the lawyers involved at the high court have been suspended. [SEP] but it ' s a shame, and it ' s not too bad for one of us [SEP]", "detok_text": "[CLS] gmt. [SEP] the average price of single - or single - family homes in california is expected to rise by 50 percent in the next 12 months. [SEP] at the moment, we don't have much room or even an extra room. [SEP] the literary pleasures of a book to read - - books, such as \"an evening, a day,\" and a bunch of \"cookbooks\" - - are the theme of the nation's literary traditions. [SEP] \" none of the lawyers involved at the high court have been suspended. [SEP] but it's a shame, and it's not too bad for one of us [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] 2009. [SEP] then he explains that he did not have the position on his hands. [SEP] standing at the back of the audience, he appeared to have a large, airy, cartoon - like look. [SEP] on the other side, clinton, 66, put together a large bunch of bread and a piece. [SEP] the person who made the announcement had no intention of leaving at the time and signing a deal, people familiar with the negotiations said. [SEP] he has little mobility and is able to walk for 15 minutes, and his son is only six years old. [SEP] the average amount of a home will be about $ 1, 000 [SEP]", "detok_text": "[CLS] 2009. [SEP] then he explains that he did not have the position on his hands. [SEP] standing at the back of the audience, he appeared to have a large, airy, cartoon - like look. [SEP] on the other side, clinton, 66, put together a large bunch of bread and a piece. [SEP] the person who made the announcement had no intention of leaving at the time and signing a deal, people familiar with the negotiations said. [SEP] he has little mobility and is able to walk for 15 minutes, and his son is only six years old. [SEP] the average amount of a home will be about $1, 000 [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] 2010. [SEP] the entire us economy has slipped into a state of recession. [SEP] the fact is that greer, the french - born author of the sex drive, is no longer willing to look elsewhere to see his work and his resumes. [SEP] you can buy a number of things that are bigger - than - life. [SEP] mr brown said the move was a \" very important partnership \" for ssp, a uk - based organisation, which has become a household name. [SEP] \" we just have to get really serious, it sort of all is wrong, but we want to get something better, \" he said. [SEP] the company [SEP]", "detok_text": "[CLS] 2010. [SEP] the entire us economy has slipped into a state of recession. [SEP] the fact is that greer, the french - born author of the sex drive, is no longer willing to look elsewhere to see his work and his resumes. [SEP] you can buy a number of things that are bigger - than - life. [SEP] mr brown said the move was a \"very important partnership\" for ssp, a uk - based organisation, which has become a household name. [SEP] \"we just have to get really serious, it sort of all is wrong, but we want to get something better,\" he said. [SEP] the company [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] of his departure from the competition, the paper added. [SEP] they never made it to us and that means we have never got the best of the world. [SEP] sure, he hit the head and swiveled it off the track, but the 40 - year old got away from the field and fought back. [SEP] the attack took place in the sunni region of east baghdad. [SEP] \" it ' s time to try to balance the puzzle and put my hands together, i ' ll be in a position to go, \" he said. [SEP] he ' s also trying to prove that he ' s got his hand in afghanistan. [SEP] [SEP]", "detok_text": "[CLS] of his departure from the competition, the paper added. [SEP] they never made it to us and that means we have never got the best of the world. [SEP] sure, he hit the head and swiveled it off the track, but the 40 - year old got away from the field and fought back. [SEP] the attack took place in the sunni region of east baghdad. [SEP] \"it's time to try to balance the puzzle and put my hands together, i'll be in a position to go,\" he said. [SEP] he's also trying to prove that he's got his hand in afghanistan. [SEP] [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS] take place in the aug. [SEP] \" they need to get in touch with their children because it is their school, their family, \" dr clasley says. [SEP] \" i had a lot of money to set up but it didn ' t mean that i can ' t buy. [SEP] there is one reason to avoid strawberry wambar, the tomato - flavored dessert flavored with butter - like chocolate. [SEP] the dems, if not democrats, make an easy effort to explain themselves, not themselves. [SEP] during their three - year term, the company developed a number of small and high - energy power products in the [SEP]", "detok_text": "[CLS] take place in the aug. [SEP] \"they need to get in touch with their children because it is their school, their family,\" dr clasley says. [SEP] \" i had a lot of money to set up but it didn't mean that i can't buy. [SEP] there is one reason to avoid strawberry wambar, the tomato - flavored dessert flavored with butter - like chocolate. [SEP] the dems, if not democrats, make an easy effort to explain themselves, not themselves. [SEP] during their three - year term, the company developed a number of small and high - energy power products in the [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] want to get access to education. [SEP] it is part of the city ' s 100 - year - old communal tradition. [SEP] mr. stauer was able to fill in the interview, which he did, even when he was 13, with one of her children, who had to do with her job, but didn ' t have the money to do it in public. [SEP] \" i don ' t want anything in your car, \" she said. [SEP] normally, i only knew if i wanted to know if things would go wrong, but that would do a lot of work. [SEP] bp, the world ' s largest operator [SEP]", "detok_text": "[CLS] want to get access to education. [SEP] it is part of the city's 100 - year - old communal tradition. [SEP] mr. stauer was able to fill in the interview, which he did, even when he was 13, with one of her children, who had to do with her job, but didn't have the money to do it in public. [SEP] \"i don't want anything in your car,\" she said. [SEP] normally, i only knew if i wanted to know if things would go wrong, but that would do a lot of work. [SEP] bp, the world's largest operator [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] see it, \" he said. [SEP] that is when i don ' t like to be at a club. [SEP] yet, no one wanted to change their mind. [SEP] in addition, there will be a chance to bring democracy to haiti. [SEP] the problem, of course, is that unless the last one in the greek mythology is solved, suddenly it looks like something might have happened. [SEP] the man, who is unconscious, left the scene and left in a waiting car. [SEP] but that ' s not news. [SEP] i don ' t want to... [SEP] this is more of a new start, expected to take about [SEP]", "detok_text": "[CLS] see it, \" he said. [SEP] that is when i don't like to be at a club. [SEP] yet, no one wanted to change their mind. [SEP] in addition, there will be a chance to bring democracy to haiti. [SEP] the problem, of course, is that unless the last one in the greek mythology is solved, suddenly it looks like something might have happened. [SEP] the man, who is unconscious, left the scene and left in a waiting car. [SEP] but that's not news. [SEP] i don't want to... [SEP] this is more of a new start, expected to take about [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] price of $ 50. [SEP] if you had weapons, communications, equipment, water, education, nothing would come out of them. [SEP] \" i don ' t think you want to do that but if we get off better we play very well. [SEP] on september 11, 2003, the ranger ' s helicopter went down on the ground. [SEP] so far, markets have taken a bit of action in recent days. [SEP] he said the company does not report earnings in the near term. [SEP] \" i can ' t tell you why he ended up for the presidency - - but i have had a lot of conversation, \" he says. [SEP]", "detok_text": "[CLS] price of $50. [SEP] if you had weapons, communications, equipment, water, education, nothing would come out of them. [SEP] \"i don't think you want to do that but if we get off better we play very well. [SEP] on september 11, 2003, the ranger's helicopter went down on the ground. [SEP] so far, markets have taken a bit of action in recent days. [SEP] he said the company does not report earnings in the near term. [SEP]\" i can't tell you why he ended up for the presidency - - but i have had a lot of conversation, \" he says. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS] really close to trying to get your foot back in the office. [SEP] i believe that my son can do, i just think we do what we need. [SEP] the ruling must be returned to the court on wednesday. [SEP] \" it ' s a lot that ' s still a problem, \" he said. [SEP] if you bought a bike and thought it was a good idea, what would any of us have to do then? [SEP] i don ' t have to have a love thing, \" she said. [SEP] however, it does not seem appropriate that the old boys seemed to reject it. [SEP] dr michael jordan, the doctor who [SEP]", "detok_text": "[CLS] really close to trying to get your foot back in the office. [SEP] i believe that my son can do, i just think we do what we need. [SEP] the ruling must be returned to the court on wednesday. [SEP] \"it's a lot that's still a problem,\" he said. [SEP] if you bought a bike and thought it was a good idea, what would any of us have to do then? [SEP] i don't have to have a love thing, \" she said. [SEP] however, it does not seem appropriate that the old boys seemed to reject it. [SEP] dr michael jordan, the doctor who [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] 2. 06 percent. [SEP] retail sales for the six months to january are 0. 7 per cent higher than in the year to march, according to official figures from the aa. [SEP] then he got to buy everything he knew - - and began to take his clothes at home - - and even put in one of his own - - in the back of the building, just to know something he had done. [SEP] so that is the right point. [SEP] the red wings took control in the opening period with 9 minutes left late into the third. [SEP] there will also need to be a better atmosphere at the club. [SEP] however, [SEP]", "detok_text": "[CLS] 2. 06 percent. [SEP] retail sales for the six months to january are 0. 7 per cent higher than in the year to march, according to official figures from the aa. [SEP] then he got to buy everything he knew - - and began to take his clothes at home - - and even put in one of his own - - in the back of the building, just to know something he had done. [SEP] so that is the right point. [SEP] the red wings took control in the opening period with 9 minutes left late into the third. [SEP] there will also need to be a better atmosphere at the club. [SEP] however, [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS], simmons 0 - 0 - 1 0 - 0, bell 0 - 5 0 - 0 0 - 0 0 0 - 0 2, mobley 5 - 11, thomas 5 - 16, chicago 1 - 4. [SEP] the report, which is the first project to be released by the company, told the times it has become possible for more people to get in touch with their children rather than simply getting to the site. [SEP] \" it feels like i ' m going to die. [SEP] sales in june rose 11. 4 per cent to $ 100, 000. [SEP] irvine, calif. - if you know what ' s going [SEP]", "detok_text": "[CLS], simmons 0 - 0 - 1 0 - 0, bell 0 - 5 0 - 0 0 - 0 0 0 - 0 2, mobley 5 - 11, thomas 5 - 16, chicago 1 - 4. [SEP] the report, which is the first project to be released by the company, told the times it has become possible for more people to get in touch with their children rather than simply getting to the site. [SEP] \" it feels like i'm going to die. [SEP] sales in june rose 11. 4 per cent to $100, 000. [SEP] irvine, calif. - if you know what's going [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] the end, to the end, and we have to get to the end of the story. [SEP] however, he spent part of a decade working for a provincial government, and in 2007 he worked in several companies. [SEP] the former president praised brawn ' s selection of hamilton, an eight - time world champion and a 13 - time champion, to win the four - man team in beijing. [SEP] but what we need to do is sit back and get a look of the place. [SEP] that ' s not to say that, if you ' re willing to go along with your bill, take a break. [SEP] however, they [SEP]", "detok_text": "[CLS] the end, to the end, and we have to get to the end of the story. [SEP] however, he spent part of a decade working for a provincial government, and in 2007 he worked in several companies. [SEP] the former president praised brawn's selection of hamilton, an eight - time world champion and a 13 - time champion, to win the four - man team in beijing. [SEP] but what we need to do is sit back and get a look of the place. [SEP] that's not to say that, if you're willing to go along with your bill, take a break. [SEP] however, they [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] hands disappeared into the air. [SEP] the nets led 50 - 50 with 1 minutes left in the opening period less than two minutes into the half. [SEP] when you think about the characters, you feel very old. [SEP] the s & p 500 was down 0. 5 percent, but the new york - based nasdaq composite index lost 0. 6 percent to 2, 724. 80. [SEP] but this was a gain of a little more than. 9 percent in december, with the market already at the top of the agenda. [SEP] \" we lived for 80 years, so we ' re there, \" he said. [SEP] [SEP]", "detok_text": "[CLS] hands disappeared into the air. [SEP] the nets led 50 - 50 with 1 minutes left in the opening period less than two minutes into the half. [SEP] when you think about the characters, you feel very old. [SEP] the s & p 500 was down 0. 5 percent, but the new york - based nasdaq composite index lost 0. 6 percent to 2, 724. 80. [SEP] but this was a gain of a little more than. 9 percent in december, with the market already at the top of the agenda. [SEP] \"we lived for 80 years, so we're there,\" he said. [SEP] [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] bush ' s top diplomat, said at a news briefing held on the morning of july 11 that the afghan government, with support from us and other international forces, should not try to face the possibility of a real arms race. [SEP] i think he ' s a very good player... [SEP] \" obviously, if we thought we ' d never have been, there was something we can do to have one, we have, but we have one, we will stay out, we will come in, \" said davis, who was among nine staffers - - all of them who lost their own seat. [SEP] he refused to answer [SEP]", "detok_text": "[CLS] bush's top diplomat, said at a news briefing held on the morning of july 11 that the afghan government, with support from us and other international forces, should not try to face the possibility of a real arms race. [SEP] i think he's a very good player... [SEP] \"obviously, if we thought we'd never have been, there was something we can do to have one, we have, but we have one, we will stay out, we will come in,\" said davis, who was among nine staffers - - all of them who lost their own seat. [SEP] he refused to answer [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], 000 school children were among the 70, 000 people affected by the earthquake. [SEP] he allowed only two runs in 4 1 / 3 - 2 3 / 3 innings and one walk for the tigers. [SEP] i don ' t like to talk about the marriage. [SEP] american officials have also warned that there will be a \" significant risk \" if the u. s. continues to pursue a military effort against al - qaida. [SEP] but the burdens, however, can only be applied to the public face of what has been a structural imbalance in their economies and other rich nations. [SEP] it ' s even more complicated, [SEP]", "detok_text": "[CLS], 000 school children were among the 70, 000 people affected by the earthquake. [SEP] he allowed only two runs in 4 1/3 - 2 3/3 innings and one walk for the tigers. [SEP] i don't like to talk about the marriage. [SEP] american officials have also warned that there will be a \"significant risk\" if the u. s. continues to pursue a military effort against al - qaida. [SEP] but the burdens, however, can only be applied to the public face of what has been a structural imbalance in their economies and other rich nations. [SEP] it's even more complicated, [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] do not believe there is any evidence that the security agreement in iraq has been ended. [SEP] since obama has promised to end all the civil rights, if not necessary, it would be an attempt to start a democratic campaign to end this process. [SEP] the idea is to place large pots of corn in the crooks of a road, in place of branches, cars and trees. [SEP] like me, however, i feel a little more confident, if with a little look and a little smile. [SEP] an estimated 4. 5 million people are homeless. [SEP] \" i ' m trying to finish, \" he said. [SEP] he also wants [SEP]", "detok_text": "[CLS] do not believe there is any evidence that the security agreement in iraq has been ended. [SEP] since obama has promised to end all the civil rights, if not necessary, it would be an attempt to start a democratic campaign to end this process. [SEP] the idea is to place large pots of corn in the crooks of a road, in place of branches, cars and trees. [SEP] like me, however, i feel a little more confident, if with a little look and a little smile. [SEP] an estimated 4. 5 million people are homeless. [SEP] \"i'm trying to finish,\" he said. [SEP] he also wants [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS] rose to 28. 5 % for the year from 26. 3 % a year ago. [SEP] the only option for a second vaccine is to check the safety and health effects of the vaccine. [SEP] a 33 - year - old nigerian man, charged with resisting police bail, jumped onto the air force ' s flight to the united states. [SEP] i hope that someone will make it out there and take them to the game, \" he said. [SEP] also at the same time, spain ' s new defense minister, carlos borges, also said he would ask the european union to increase military force in afghanistan. [SEP] the e - mail [SEP]", "detok_text": "[CLS] rose to 28. 5 % for the year from 26. 3 % a year ago. [SEP] the only option for a second vaccine is to check the safety and health effects of the vaccine. [SEP] a 33 - year - old nigerian man, charged with resisting police bail, jumped onto the air force's flight to the united states. [SEP] i hope that someone will make it out there and take them to the game, \" he said. [SEP] also at the same time, spain's new defense minister, carlos borges, also said he would ask the european union to increase military force in afghanistan. [SEP] the e - mail [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] of the detainees, but said he had no idea of them. [SEP] \" when we realized he was still five miles away, we thought he was right in the air and it was great to walk, \" said james molinaro, a 38 - year - old campaign office manager. [SEP] in the end, everything is dead. [SEP] \" i have to sacrifice my patience to get things done. [SEP] when i run into a couple of things, i ' d like to be realistic. [SEP] \" we ' ll look at a state level to have a much greater understanding of what an individual is in the workplace. [SEP] that ' s when [SEP]", "detok_text": "[CLS] of the detainees, but said he had no idea of them. [SEP] \"when we realized he was still five miles away, we thought he was right in the air and it was great to walk,\" said james molinaro, a 38 - year - old campaign office manager. [SEP] in the end, everything is dead. [SEP] \"i have to sacrifice my patience to get things done. [SEP] when i run into a couple of things, i'd like to be realistic. [SEP]\" we'll look at a state level to have a much greater understanding of what an individual is in the workplace. [SEP] that's when [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] said. [SEP] \" it would normally have been an act of money, but sometimes it is just really simple, \" he said. [SEP] \" no one is not going to get involved, \" he said. [SEP] i ' ve been doing it since the start of the season and, had i been there for a while, it usually became a very long trip. [SEP] \" you cannot feel the pressure. [SEP] \" if there is a guy that is going to be a lot of pressure, i will not make any changes, \" he said. [SEP] there are other assets that could be useful to investors in the long run. [SEP] the [SEP]", "detok_text": "[CLS] said. [SEP] \"it would normally have been an act of money, but sometimes it is just really simple,\" he said. [SEP] \"no one is not going to get involved,\" he said. [SEP] i've been doing it since the start of the season and, had i been there for a while, it usually became a very long trip. [SEP] \"you cannot feel the pressure. [SEP]\" if there is a guy that is going to be a lot of pressure, i will not make any changes, \" he said. [SEP] there are other assets that could be useful to investors in the long run. [SEP] the [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] two other us service personnel were killed in a helicopter bomb crash in afghanistan. [SEP] \" you can see how we do things. [SEP] it is good to think it ' s important to understand that there ' s something written in that - - and try to get some feedback on it. [SEP] that is our thought for a couple of months. [SEP] \" i don ' t want to see what is changed. [SEP] together, they ' re lovely and sexy, it ' s more realistic and romantic. [SEP] \" i never had anyone in the national team, i never had a taste for it. [SEP] so, i understand. [SEP] and if [SEP]", "detok_text": "[CLS] two other us service personnel were killed in a helicopter bomb crash in afghanistan. [SEP] \"you can see how we do things. [SEP] it is good to think it's important to understand that there's something written in that - - and try to get some feedback on it. [SEP] that is our thought for a couple of months. [SEP]\" i don't want to see what is changed. [SEP] together, they're lovely and sexy, it's more realistic and romantic. [SEP] \" i never had anyone in the national team, i never had a taste for it. [SEP] so, i understand. [SEP] and if [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] in january 2010. [SEP] his identity was confirmed by his prison guards before he was returned to the prison, where he was held there in october 2002. [SEP] \" it is not when you talk, when you look for a joke, \" he said. [SEP] i thought i went too far. [SEP] but he said that there would be a five - year deal with germany, an end to the war in afghanistan, as well as iran. [SEP] i think most of the iranian people would have been able to turn their country into a democracy. [SEP] the president ' s vacation needs to last for a week or two. [SEP] she moved her [SEP]", "detok_text": "[CLS] in january 2010. [SEP] his identity was confirmed by his prison guards before he was returned to the prison, where he was held there in october 2002. [SEP] \"it is not when you talk, when you look for a joke,\" he said. [SEP] i thought i went too far. [SEP] but he said that there would be a five - year deal with germany, an end to the war in afghanistan, as well as iran. [SEP] i think most of the iranian people would have been able to turn their country into a democracy. [SEP] the president's vacation needs to last for a week or two. [SEP] she moved her [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] ' s up to them. [SEP] i ' m not going to apologize, i don ' t like what the law says. [SEP] you never see it again, \" he said. [SEP] he ' s no regrets, and no regrets, but he also seems to have to go through a couple of problems at the end of the game. [SEP] he ' s a nice guy and with a good balance and able to get things started. [SEP] but we have to work hard in the n. f. c. at all to be one of those who don ' t really want to lose - - they ' re kind of going to keep [SEP]", "detok_text": "[CLS]'s up to them. [SEP] i'm not going to apologize, i don't like what the law says. [SEP] you never see it again, \" he said. [SEP] he's no regrets, and no regrets, but he also seems to have to go through a couple of problems at the end of the game. [SEP] he's a nice guy and with a good balance and able to get things started. [SEP] but we have to work hard in the n. f. c. at all to be one of those who don't really want to lose - - they're kind of going to keep [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] in the case of the state, he said. [SEP] it is posted on the website and is only 56 % true. [SEP] but i wanted to get home. [SEP] the plant has an additional 1, 200 manufacturing capacity and is more than 5, 000 square miles ( 3, 300 ), he said. [SEP] in fact, the floor is full for you, and at this moment, it ' s all in the shape of the second floor, and when you see the room at the door, there ' s no living room, no chairs, or bedroom. [SEP] the british military will resume its regular exercise with a technical training centre [SEP]", "detok_text": "[CLS] in the case of the state, he said. [SEP] it is posted on the website and is only 56 % true. [SEP] but i wanted to get home. [SEP] the plant has an additional 1, 200 manufacturing capacity and is more than 5, 000 square miles (3, 300), he said. [SEP] in fact, the floor is full for you, and at this moment, it's all in the shape of the second floor, and when you see the room at the door, there's no living room, no chairs, or bedroom. [SEP] the british military will resume its regular exercise with a technical training centre [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] to spend much of the day. [SEP] \" i ' ve never done any of my tests and i know when he is going to play south africa i don ' t think that that is something i really want to do again, \" said wester. [SEP] it is that if there has to be a person living in the city - - it is like the end of a political year. [SEP] a spokesman for doug hoffman, a davis ' lawyer, said he had told the jury that the attack was of public safety and that he did not have the right to take action in the court. [SEP] i don ' t think a real estate [SEP]", "detok_text": "[CLS] to spend much of the day. [SEP] \"i've never done any of my tests and i know when he is going to play south africa i don't think that that is something i really want to do again,\" said wester. [SEP] it is that if there has to be a person living in the city - - it is like the end of a political year. [SEP] a spokesman for doug hoffman, a davis' lawyer, said he had told the jury that the attack was of public safety and that he did not have the right to take action in the court. [SEP] i don't think a real estate [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] agenda. [SEP] mr. cohen returned to europe to run the company in a further few years. [SEP] it ' s possible, in the general sense, that we have to put on a show of, well, something that has a history, i ' d love to have a chance to show that, to do something in a bit of context. [SEP] he added that, among other things, the uk could become more able to deal with long - term problems. [SEP] the north has begun making new travel plans to allow aid and entry to the border, and also has ordered a full end of access to the buffer zone. [SEP] the [SEP]", "detok_text": "[CLS] agenda. [SEP] mr. cohen returned to europe to run the company in a further few years. [SEP] it's possible, in the general sense, that we have to put on a show of, well, something that has a history, i'd love to have a chance to show that, to do something in a bit of context. [SEP] he added that, among other things, the uk could become more able to deal with long - term problems. [SEP] the north has begun making new travel plans to allow aid and entry to the border, and also has ordered a full end of access to the buffer zone. [SEP] the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] he was wearing brown jeans and armed with a white shirt, an coloured jacket and a white tie. [SEP] he said : \" he has never had a lot of money. [SEP] that ' s a big thing. [SEP] \" i have to say the last three years, you are following one of the many things that have come on in the last 10 years. [SEP] the real deal is insurance. [SEP] that ' s what they can do. [SEP] that isn ' t what we want, he says. [SEP] the team knows that he will be able to take part at milan, but he is always on the road. [SEP] in a conference [SEP]", "detok_text": "[CLS] he was wearing brown jeans and armed with a white shirt, an coloured jacket and a white tie. [SEP] he said: \"he has never had a lot of money. [SEP] that's a big thing. [SEP]\" i have to say the last three years, you are following one of the many things that have come on in the last 10 years. [SEP] the real deal is insurance. [SEP] that's what they can do. [SEP] that isn't what we want, he says. [SEP] the team knows that he will be able to take part at milan, but he is always on the road. [SEP] in a conference [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] insurers. [SEP] i spoke to her right outside. [SEP] \" so we ' re going to get in a little more than a little bit, \" he said. [SEP] \" it is a game that we don ' t know in the past, yet we all have a respect for the players. [SEP] he has described his attacker as a \" little henger. \" [SEP] i dished out and he seemed to be able to make his way. [SEP] \" it ' s been a quarter of a century, \" she said. [SEP] the government has announced the release of tens of thousands of police, police and intelligence workers, from [SEP]", "detok_text": "[CLS] insurers. [SEP] i spoke to her right outside. [SEP] \"so we're going to get in a little more than a little bit,\" he said. [SEP] \"it is a game that we don't know in the past, yet we all have a respect for the players. [SEP] he has described his attacker as a\" little henger. \"[SEP] i dished out and he seemed to be able to make his way. [SEP]\" it's been a quarter of a century, \" she said. [SEP] the government has announced the release of tens of thousands of police, police and intelligence workers, from [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] said. [SEP] if you are successful, you will have to be careful before the end of the season. [SEP] the man is in custody and police are trying to get any further information. [SEP] he even looked as if the answer was a complete lack of effort. [SEP] but mr. brown said the question of this needed to be addressed. [SEP] the bank suffered $ 3. 4 billion in losses in the first quarter of fiscal 2008. [SEP] the entire site is supposed to be close to capacity. [SEP] after all, he said, most of the staff and crew would be allowed to come back in full by march. [SEP] \" the truth [SEP]", "detok_text": "[CLS] said. [SEP] if you are successful, you will have to be careful before the end of the season. [SEP] the man is in custody and police are trying to get any further information. [SEP] he even looked as if the answer was a complete lack of effort. [SEP] but mr. brown said the question of this needed to be addressed. [SEP] the bank suffered $3. 4 billion in losses in the first quarter of fiscal 2008. [SEP] the entire site is supposed to be close to capacity. [SEP] after all, he said, most of the staff and crew would be allowed to come back in full by march. [SEP] \" the truth [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] he worked out the layout of his wife ' s home, a one - bedroom apartment in seattle, he wrote. [SEP] \" when i get to work, that ' s good. [SEP] it ' s strange he was in trouble, but at least he wanted to know how he felt when he was seeing himself on television, he said. [SEP] a number of sources said the council had no regrets. [SEP] it was a big step, according to lacker. [SEP] \" it ' s going to be the last of the season, it ' s a matter of time, \" he said. [SEP] i do not think we ' re trying [SEP]", "detok_text": "[CLS] he worked out the layout of his wife's home, a one - bedroom apartment in seattle, he wrote. [SEP] \"when i get to work, that's good. [SEP] it's strange he was in trouble, but at least he wanted to know how he felt when he was seeing himself on television, he said. [SEP] a number of sources said the council had no regrets. [SEP] it was a big step, according to lacker. [SEP]\" it's going to be the last of the season, it's a matter of time, \" he said. [SEP] i do not think we're trying [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS] 000 troops. [SEP] british police would not comment on the incident. [SEP] he and his brother and sister were all released tuesday. [SEP] crude oil prices in the first six months of the year hit a record high of $ 65bn, up 14 per cent to $ 25. 4bn ( £17. 7bn ), on better - than - expected figures from oil and mining companies. [SEP] the house ' s bill also provides banks up to $ 2, 000 for loans, including loans and interest payments made to the fha. [SEP] but the figure ' s figure climbed to 7 per cent from 3. 7 million. [SEP] there [SEP]", "detok_text": "[CLS] 000 troops. [SEP] british police would not comment on the incident. [SEP] he and his brother and sister were all released tuesday. [SEP] crude oil prices in the first six months of the year hit a record high of $65bn, up 14 per cent to $25. 4bn (£17. 7bn), on better - than - expected figures from oil and mining companies. [SEP] the house's bill also provides banks up to $2, 000 for loans, including loans and interest payments made to the fha. [SEP] but the figure's figure climbed to 7 per cent from 3. 7 million. [SEP] there [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] system, and the market is able to turn to mark - to - market capital growth. \" [SEP] \" if we were to win, we would have to get there, we have to go to win, and we would have to do whatever we could do, we would not do that, \" mullen said. [SEP] it ' s good enough to take pride in life. [SEP] \" it ' d be nice to be taken up in the end, \" nadal said. [SEP] \" i do remember him. [SEP] as a result, a patient has to learn about how to talk to people. [SEP] in a statement, the organization [SEP]", "detok_text": "[CLS] system, and the market is able to turn to mark - to - market capital growth. \"[SEP]\" if we were to win, we would have to get there, we have to go to win, and we would have to do whatever we could do, we would not do that, \"mullen said. [SEP] it's good enough to take pride in life. [SEP]\" it'd be nice to be taken up in the end, \"nadal said. [SEP]\" i do remember him. [SEP] as a result, a patient has to learn about how to talk to people. [SEP] in a statement, the organization [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] in chicago, has worked for several years at the university of maryland. [SEP] \" of course, we have taken some steps to get out of the situation, we have to take it through, to get it done, right. [SEP] \" every time i really have to do something, it ' s hard when i ' m going to be in line for another year, \" he told reporters after heading into the locker room. [SEP] \" i came back in time and said, and she said, ' i ' ve got got to do this, i wanted to play, and i wasn ' t really interested. [SEP] we ' re already [SEP]", "detok_text": "[CLS] in chicago, has worked for several years at the university of maryland. [SEP] \"of course, we have taken some steps to get out of the situation, we have to take it through, to get it done, right. [SEP]\" every time i really have to do something, it's hard when i'm going to be in line for another year, \"he told reporters after heading into the locker room. [SEP]\" i came back in time and said, and she said, ' i've got got to do this, i wanted to play, and i wasn't really interested. [SEP] we're already [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] way to ensure that the end - of - life information on the web site has not been used, the post reported. [SEP] ( 21 - 22 ) : you may be able to pay you off, especially when you do want to travel one way and pay off all the money on the holidays. [SEP] i have always wondered here about why people are going to be there. [SEP] the issue of land and water, the world ' s most sought - after area of long - term development, was resolved in a little less than a week. [SEP] one of the injured was a school teacher in peshawar, about 50 miles from the airport. [SEP]", "detok_text": "[CLS] way to ensure that the end - of - life information on the web site has not been used, the post reported. [SEP] (21 - 22): you may be able to pay you off, especially when you do want to travel one way and pay off all the money on the holidays. [SEP] i have always wondered here about why people are going to be there. [SEP] the issue of land and water, the world's most sought - after area of long - term development, was resolved in a little less than a week. [SEP] one of the injured was a school teacher in peshawar, about 50 miles from the airport. [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] percent in the second quarter, is still looking to add the $ 3, 700 billion cut from the tarp program to the additional $ 50 billion in additional guarantees it would provide to help stabilize the financial system over the next year. [SEP] wilco had his first full game, leaving his left glove behind on the mound. [SEP] c £40, 000 ( + £36, 702 ). central london. £35, 000 - £30, 703 ( luling up to £39, 092 per annum. £32, 071 - 1. we are looking for a permanent b.... [SEP] \" [SEP]", "detok_text": "[CLS] percent in the second quarter, is still looking to add the $3, 700 billion cut from the tarp program to the additional $50 billion in additional guarantees it would provide to help stabilize the financial system over the next year. [SEP] wilco had his first full game, leaving his left glove behind on the mound. [SEP] c £40, 000 (+ £36, 702). central london. £35, 000 - £30, 703 ( luling up to £39, 092 per annum. £32, 071 - 1. we are looking for a permanent b.... [SEP] \" [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS], those who live here have to live with their families, \" he said. [SEP] \" i don ' t think he should go to manchester because i ' m sure he ' d like to come back. [SEP] live in the pain of having to do what is required, \" she said. [SEP] but the current human condition facing the tigers is not clear. [SEP] \" if you stop the damage, the money is going to go around, you know. [SEP] what we ' ve seen is a general improvement, \" said mr corsi. [SEP] i ' m not too sure, \" mr. catt said. [SEP] during the [SEP]", "detok_text": "[CLS], those who live here have to live with their families, \"he said. [SEP]\" i don't think he should go to manchester because i'm sure he'd like to come back. [SEP] live in the pain of having to do what is required, \"she said. [SEP] but the current human condition facing the tigers is not clear. [SEP]\" if you stop the damage, the money is going to go around, you know. [SEP] what we've seen is a general improvement, \"said mr corsi. [SEP] i'm not too sure,\" mr. catt said. [SEP] during the [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS], then drove off for a walk and left at 2 : 45 a. m., according to police at the scene. [SEP] beijing ( reuters ) - china ' s tough relations with dalai lama and beijing met again on monday to resolve a long - running dispute that has sparked growing tensions with china, according to u. s. officials. [SEP] \" it ' s about money, it ' s about people when you ' re in people ' s control, trying to understand what people they are, giving them time and money, which means you want to do what you want to know to do.... [SEP] the difference is [SEP]", "detok_text": "[CLS], then drove off for a walk and left at 2: 45 a. m., according to police at the scene. [SEP] beijing (reuters) - china's tough relations with dalai lama and beijing met again on monday to resolve a long - running dispute that has sparked growing tensions with china, according to u. s. officials. [SEP] \" it's about money, it's about people when you're in people's control, trying to understand what people they are, giving them time and money, which means you want to do what you want to know to do.... [SEP] the difference is [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS] to the polls. [SEP] \" the choice for you is not to stick to any solution but to review matters now, to talk directly to the prime minister, the foreign minister, \" said britain ' s prime minister gordon brown. [SEP] \" there ' s a question, we ' re going to say, ' if we are really prepared for this, we ' ll have an election, that ' s fine, \" daube said. [SEP] \" we have not stopped, we have no plans, \" he said. [SEP] when he came to the project, he changed his mind, but promised that it would provide a little more space [SEP]", "detok_text": "[CLS] to the polls. [SEP] \"the choice for you is not to stick to any solution but to review matters now, to talk directly to the prime minister, the foreign minister,\" said britain's prime minister gordon brown. [SEP] \"there's a question, we're going to say, ' if we are really prepared for this, we'll have an election, that's fine,\" daube said. [SEP] \"we have not stopped, we have no plans,\" he said. [SEP] when he came to the project, he changed his mind, but promised that it would provide a little more space [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS]. [SEP] i mean, i can spend too much time with him on our backs next year, but i wish i had just finished my first year, i ' m sure we can get that too much attention. [SEP] he, however, was not in the audience. [SEP] but, that doesn ' t mean it ' s worth saying to me, that i know i want to do something about it, that i want to make an impact. [SEP] by the end of the week, all of us have returned to our vacation homes. [SEP] but for some of them, this kind of action must have seemed long ago. [SEP] the lack [SEP]", "detok_text": "[CLS]. [SEP] i mean, i can spend too much time with him on our backs next year, but i wish i had just finished my first year, i'm sure we can get that too much attention. [SEP] he, however, was not in the audience. [SEP] but, that doesn't mean it's worth saying to me, that i know i want to do something about it, that i want to make an impact. [SEP] by the end of the week, all of us have returned to our vacation homes. [SEP] but for some of them, this kind of action must have seemed long ago. [SEP] the lack [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS]m loss for the firm, which had revenue of £19, 000. [SEP] he ' s a very good person, \" mr brown said. [SEP] well, i think it was a good idea. [SEP] we don ' t want to do anything about the greatness of life, but we do have to make a decision. [SEP] a combined total of more than 500, 000 sodas were sold, including more than 2, 000 to consumers in 2007, according to steve mellow, general manager of the beverage industry association. [SEP] the deal also includes two activities - - the gym, the golf club, the dining area, and [SEP]", "detok_text": "[CLS]m loss for the firm, which had revenue of £19, 000. [SEP] he's a very good person, \" mr brown said. [SEP] well, i think it was a good idea. [SEP] we don't want to do anything about the greatness of life, but we do have to make a decision. [SEP] a combined total of more than 500, 000 sodas were sold, including more than 2, 000 to consumers in 2007, according to steve mellow, general manager of the beverage industry association. [SEP] the deal also includes two activities - - the gym, the golf club, the dining area, and [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] of rising debt into the economy. [SEP] however, that was brought to the attention. [SEP] the market then was down. [SEP] look at how you could get to see a lot of people reading stories and people here to read them. [SEP] it is not really what they want us to see. [SEP] if it comes back, i won ' t be looking out. [SEP] i just hope that all of this should be corrected. [SEP] don ' t expect them to tell me to do anything, as i always have to say here, but of course, i ' m trying to tell you that it all happened in the united states. [SEP] [SEP]", "detok_text": "[CLS] of rising debt into the economy. [SEP] however, that was brought to the attention. [SEP] the market then was down. [SEP] look at how you could get to see a lot of people reading stories and people here to read them. [SEP] it is not really what they want us to see. [SEP] if it comes back, i won't be looking out. [SEP] i just hope that all of this should be corrected. [SEP] don't expect them to tell me to do anything, as i always have to say here, but of course, i'm trying to tell you that it all happened in the united states. [SEP] [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] flights will be made from new york, the u. s. and canada. [SEP] it ' s a way to give you a break, a way to play, \" biden said. [SEP] \" i think for a lot of people, there ' s a problem, \" he said. [SEP] we ' d have to win. [SEP] he was mostly out of games in recent seasons, and he seemed to make quite a few hits. [SEP] his mother was unable to get to the hospital. [SEP] \" there has been tremendous change in the team since the end of the year. [SEP] \" i ' m just saying these things when i [SEP]", "detok_text": "[CLS] flights will be made from new york, the u. s. and canada. [SEP] it's a way to give you a break, a way to play, \"biden said. [SEP]\" i think for a lot of people, there's a problem, \"he said. [SEP] we'd have to win. [SEP] he was mostly out of games in recent seasons, and he seemed to make quite a few hits. [SEP] his mother was unable to get to the hospital. [SEP]\" there has been tremendous change in the team since the end of the year. [SEP] \" i'm just saying these things when i [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] in the air. [SEP] it ' s not a game to plan, it ' s a \" game of good communication. \" [SEP] as a result, ba faced the prospect of trying to take control of the group in case of a bankruptcy. [SEP] if an immediate decision is made, like the vote to strike in december, they would be able to do so. [SEP] they have never been in a room with family members, and they have a film and a documentary, a lot of movies, \" she said. [SEP] \" i saw the woman at the end of the flight on a curtain call. [SEP] that ' s right, \" [SEP]", "detok_text": "[CLS] in the air. [SEP] it's not a game to plan, it's a \"game of good communication.\" [SEP] as a result, ba faced the prospect of trying to take control of the group in case of a bankruptcy. [SEP] if an immediate decision is made, like the vote to strike in december, they would be able to do so. [SEP] they have never been in a room with family members, and they have a film and a documentary, a lot of movies, \"she said. [SEP]\" i saw the woman at the end of the flight on a curtain call. [SEP] that's right, \" [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] i could care for him. [SEP] \" i ' ve got a career as a doctor, so it doesn ' t work for me anymore, it ' s not a good one, \" eno said. [SEP] i was happy for him. [SEP] if i want to become a science teacher, i have to do a few things, \" rahm told reporters. [SEP] \" we are unable to confirm the report to the committee and expect to give evidence to the full council later in march, and are working to get the further action forward, \" the statement said. [SEP] in the second round of the conference title, the cavaliers won their [SEP]", "detok_text": "[CLS] i could care for him. [SEP] \"i've got a career as a doctor, so it doesn't work for me anymore, it's not a good one,\" eno said. [SEP] i was happy for him. [SEP] if i want to become a science teacher, i have to do a few things, \"rahm told reporters. [SEP]\" we are unable to confirm the report to the committee and expect to give evidence to the full council later in march, and are working to get the further action forward, \" the statement said. [SEP] in the second round of the conference title, the cavaliers won their [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS].. fl. training - education is assigned to oversee........ and other activities related to this program. are immediately available to assist.... de.. in coordinating with international organizations, corporations and other.... mn. 08 / 07 : / hh ( and many of you currently have.... in... il, paris, ct, and washington, dc. someone needs to be responsible for a position able to lead.... co. access to education, degree of experience... ct, level of experience to be a teacher or.. [SEP]", "detok_text": "[CLS].. fl. training - education is assigned to oversee........ and other activities related to this program. are immediately available to assist.... de.. in coordinating with international organizations, corporations and other.... mn. 08/07:/hh ( and many of you currently have.... in... il, paris, ct, and washington, dc. someone needs to be responsible for a position able to lead.... co. access to education, degree of experience... ct, level of experience to be a teacher or.. [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] the area. [SEP] \" it increases the brain ' s ability to communicate, \" buffon said. [SEP] he ' s done that. [SEP] a person wants to look back at your eyes - - the eyes of a man - - but he gives up an outline of his mind every 15 minutes. [SEP] i have to remember how to take my time at the far end of things. [SEP] there is nothing more to this story in the spirit of adventure than the illusion of good quality. [SEP] look, they ' ve only been a bit lower since the end of the year. [SEP] \" we don ' t know how to go about it [SEP]", "detok_text": "[CLS] the area. [SEP] \"it increases the brain's ability to communicate,\" buffon said. [SEP] he's done that. [SEP] a person wants to look back at your eyes - - the eyes of a man - - but he gives up an outline of his mind every 15 minutes. [SEP] i have to remember how to take my time at the far end of things. [SEP] there is nothing more to this story in the spirit of adventure than the illusion of good quality. [SEP] look, they've only been a bit lower since the end of the year. [SEP] \" we don't know how to go about it [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/state_c256_t1p45_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/state_c256_t1p45_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..cbcfbfaaaea06853a79bd15d7e235a4adc802b56 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/state_c256_t1p45_detok_raw_samples.txt @@ -0,0 +1,228 @@ +state_c256_t1p45_detok +{ + "type": "summary", + "name": "state_c256_t1p45", + "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", + "step": 124000, + "decode": { + "kind": "categorical_fullvocab", + "config": "state_c256_t1p45", + "steps": 256, + "model_t_mode": "post", + "support_power": 1.0, + "semantic_power": 1.0, + "endpoint_temp": 1.45, + "concentration_min": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 29.81545187350111, + "nll_per_token": 3.3950267783717107, + "tokens": 9500 + }, + "diversity": { + "sample_entropy": 4.085741040367163, + "unique_tokens": 1473, + "token_count": 8192, + "distinct_1": 0.1798095703125, + "distinct_2": 0.5905511811023622, + "top_token_mass": 0.0538330078125 + } +} + +===== sample 000 ===== +[CLS] press reported. [SEP] i would have to cancel a couple of flights, but i was free to go... [SEP] the project, costing £1, 500, will make it possible to bring some of the world's best teams to the uk. [SEP] we're going to have an investigation that, with all our evidence, we have never seen before, "he added. [SEP] the carmaker ford lost $60m in the first quarter alone. [SEP]" there is a real need for transparency. [SEP] the scale of the devastation has been driven by the displacement and reshaping of nearly 10, 000 people around the world [SEP] + +===== sample 001 ===== +[CLS] - trade plan. [SEP] in the past, we have looked back at some ways, and i think the problem is, we did not get this far. [SEP] "i think, ' john, i think he's ok, but i'm not really in a position to talk to you. [SEP]" it was a little bit of a big fight and we had to be aware of it, " said the german. [SEP] for a moment, the place, if you kind of look out, seems to sit in perspective. [SEP] when a discussion of the president's fate actually takes place, so many of those who know [SEP] + +===== sample 002 ===== +[CLS] the white house, "he says. [SEP] i've never known there has been a huge factor in the game. [SEP] he likes to get up, but a little bit well, and just works well in the gym. [SEP]" i think we have to get a good deal, so if the result is a win, the majority is in danger of losing, "ender said. [SEP]" the idea is to get the money they want to get, and we're not able to make money, " added schbutter. [SEP] the police have said that they were investigating more than a dozen complaints. [SEP] but [SEP] + +===== sample 003 ===== +[CLS] quite the way we are. [SEP] i just hope that i can do it again. [SEP] he says that he doesn't think he should talk to anyone trying to sell himself. [SEP] you know we'll take our lessons, "said the foreign official. [SEP] i've liked one one, i like the other, and of course he has to deal with this if he is a candidate when he gets into it. [SEP]" there are also things you want to do with that work, such as getting dressed in white clouds, or capels, or even a black scarf, " he added. [SEP] a government agency investigating [SEP] + +===== sample 004 ===== +[CLS]: "the total of stolen items includes a number of personal items including household goods, airbags and computers. [SEP]" i don't think it was until my 70s that i really got into trouble, "he said," i can't make it much better - - i didn't even have a talking point. [SEP] officials from around the world and more than a 100 other countries attended the event. [SEP] while he is so popular in the united states, he is critical of his free - trade policies in the u. s. and calling for the collapse of the union. [SEP] the production also features a three - [SEP] + +===== sample 005 ===== +[CLS] guide them to the democratic nomination. [SEP] "i've got quite a concern about the number of people who have worked and the number of people who have been working and thought about the quality of things that are done or if they have been worked out. [SEP]" we don't want to know that he can play in the future, " said peter westbrook, the club's assistant coach. [SEP] it was last updated at 20. 54 bst on thursday 16 may 2009. office for the city of london. greater london, south london. £36, 624 to £43, 000 per annum. [SEP] he [SEP] + +===== sample 006 ===== +[CLS] air crash in rome, witnesses said. [SEP] "i'll do that and i'm glad this has been resolved. [SEP] since the 10th century, the u. s. government has never been part of iraq. [SEP] it said that after several days the children, who would be temporary workers who did not see their parents for another six weeks, would not receive full visas and would be free from their work. [SEP] i just wanted to let him stand up and try to get here," according to the eca. [SEP] the nets also scored 13 of his 15 points in 20 minutes - - he had 16 rebounds in the [SEP] + +===== sample 007 ===== +[CLS] in a series of federal deficits and budget shortcomings. [SEP] i mean, if you ask me to look at you, you're a celebrity, it's just hard to imagine. [SEP] a 19. 1 share in california's unemployment report, down slightly in chicago in august. [SEP] in the end, the swiss group had to set a compensation deal with the government and was promised the full compensation of the bank's 5, 000 employees. [SEP] so it's not been easy for him, as we both know the rules. [SEP] the first game of the series was 14 - point loss to detroit. [SEP] + +===== sample 008 ===== +[CLS] 57. 7 million. [SEP] i believe that they will not be able to pay the cost. [SEP] "if we've got a team where we are up to the task, we want to do it in terms of our commitment to football," barca said. [SEP] what has been the challenge for children to learn from the past? [SEP] mr brown said the leaders had all agreed on a get - in for the couple. [SEP] on wednesday, the protesters sent riot police, police trucks, fire engines and soldiers on their way to the stadium for a second time. [SEP] the group is led by john bord. [SEP] but [SEP] + +===== sample 009 ===== +[CLS] their vehicles. [SEP] still, it took them four years to achieve the first cut in the government's funding in three years and start to the school year. [SEP] we've told them. [SEP] the victims collected up to $20, 000 in cash, cash, cash, cash, cigarettes and cash, police said. [SEP] "when we get down to the final i think it's something that we have been trying to do for a long time for us. [SEP]" it's just a small number to look for, it's not true, "she said," " well, i don't need [SEP] + +===== sample 010 ===== +[CLS] - - "he joked. [SEP]" this announcement is a response to the lack of public funding, " said a spokesman of the children of education committee. [SEP] however, as a result, i think i'm in the right mood. [SEP] clinton has said the us will help to improve the political situation in zimbabwe. [SEP] we'll see. [SEP] and it is a great thing to help them in the day and help them in a good way. [SEP] on the other hand, one thing is to overcome this fear and prejudice. [SEP] another £1 million a year has also gone into the children's education fund, which has [SEP] + +===== sample 011 ===== +[CLS] in front of others. [SEP] it just seems to pick up the air of the wind. [SEP] boca raton, fla., march 3 (upi) - - owners of u. s. retailers said they expect to be down by as much as 10 percent in the second half of 2008, a survey said. [SEP] he lives in chicago. [SEP] he said there was no sign the club was going to replace him, so there was none of them to replace him. [SEP] the court heard the ex - president was staying at home, four years after losing the presidency in 2001. [SEP] on friday, senate republican leader john [SEP] + +===== sample 012 ===== +[CLS] weekend, said he was "tired" and had "nothing to do" with a run that was "normal" after he started. [SEP] i had the message being, "don't talk about you anymore." [SEP] i have sex every day, every 20 - year - old girl loves it. [SEP] you're always looking to pick up a job of your own or make some money, but there's a lot of work to get in. [SEP] where are your best friends? [SEP] i'm sure that he's the guy who can have the things we want, have the things that i can trust, [SEP] + +===== sample 013 ===== +[CLS]. s. kabul, afghanistan (ap) - - a roadside bomb ripped through an eastern afghan town wednesday, killing a dozen people and wounding 24 others, including three children, and a schoolgirl, provincial police and officials said. [SEP] until then, at least it hadn't come to saturday's conclusion. [SEP] "no one will be responsible for the breach of security," he added. [SEP] the safety condition of the two - lane scat would be set in proportion to a narrow exit where the driver of a car on the other side would hit the driver's hand, causing the driver to be stuck. [SEP] [SEP] + +===== sample 014 ===== +[CLS] "said mohammed. [SEP] he is so fast - - and yet he sees, at first, the freshness of the light and the warmth of the all - around sun that brought him down from the moon to earth. [SEP] we still don't know. [SEP]" you don't always know what you're going for. [SEP] "it's hard to see, it's hard to take out anything that's important at all," she says. [SEP] "we did have more problems," said coach scott brown, a member of the nfl players' association. [SEP] " the president and manager, all [SEP] + +===== sample 015 ===== +[CLS] of the children. [SEP] they won't be able to see you, but we better know them if they don't put their money on a table. [SEP] i don't know. [SEP] that used to be fine on the street, but with the doors closed and the busses running from front to back streets, it didn't go that far. [SEP] in the early 2000s, however, rates were sharply lower. [SEP] "there's a lot of work going on, and it was not wrong," he said. [SEP] " i've just got a little bit of a fight. [SEP] since then, [SEP] + +===== sample 016 ===== +[CLS] said. [SEP] similar turbines are being built in the uk, but needs to be completed by 2013, said a senior government official involved in the talks. [SEP] he made 25 of 32 shots from the field before punting on 3 - of - 13 three - goal attempts saturday night in the wild 1 - 0 loss to san jose city, the first victory of the season a day earlier. [SEP] there's a problem that can seem to cause any amount of mental pain, " said kitz. [SEP] we must change our perception, and without any change, we must still make a lot of mistakes, and act fast, and we [SEP] + +===== sample 017 ===== +[CLS] to obama's visit to america in june, that he seemed to understand that he really was going to behave in different conditions. [SEP] there is such a sense of optimism and change for you, according to cbs/kland. com. [SEP] it would be in good faith. [SEP] "that's not necessarily what we're about. [SEP] that's a good thing, it's kind of a joke. [SEP] wake up and drop the story for comment. [SEP]" we believe that we still have the ability to win, " said mr brown. [SEP] new york - kirilenko scored 26 points and jason terry [SEP] + +===== sample 018 ===== +[CLS] in the first quarter of december 2007. [SEP] the u. s. c. arrived at the air station at about 8 a. m. and returned immediately, according to one person with knowledge of the condition of monday's departures. [SEP] the president has gotten the message quickly and cautioned citizens to be on alert. [SEP] capello's team could play against the united states in this week's group stage, and italy has three games in the final, but it's not. [SEP] then, however, we moved into the middle of a relationship. [SEP] lake city, ill. - - the man who killed [SEP] + +===== sample 019 ===== +[CLS] confirmed his move to rangers on tuesday and are due to start their european campaign in the light of the first game of chelsea's trip to ibrox. [SEP] the trial was scheduled to take place in 2009. [SEP] we're not doing enough - - we will get that fast if we can go. [SEP] for example, the concept of a low - end car could go on the road. [SEP] "i'm concerned that we will have a new set of rules that we have to sort out, and there will be more changes in financial financial systems over the couple of years," he said. [SEP] the capital, [SEP] + +===== sample 020 ===== +[CLS] person familiar with the matter. [SEP] new york's health insurance program is designed to inflate financial costs. [SEP] it took only a few minutes to develop. [SEP] at that time, in february 2008, the percentage of people paying a 10 - year mortgage rose this year from 13 % to 3. 8 %. [SEP] they let us do nothing in the past. [SEP] "we don't talk about a financial crisis, it's just getting people together," he added. [SEP] but the goal is to make up for the fire that is coming in markets that are getting stressed, including mortgage - backed securities, which [SEP] + +===== sample 021 ===== +[CLS] still lives, and he knows how to make a living. [SEP] the council has provided £5, 000 to cover the building and £5, 000 to design, with the rest still to be added. [SEP] it is really hard for him to see anything in a way. [SEP] the mets are trying to add santana, for example, who is looking for a good season. [SEP] then she dropped off her clothes. [SEP] he is still trying to keep a lead while even keeping the ball in playoff games. [SEP] the union said it represents more than 2, 000 temporary workers, and that drivers would have to work overtime. [SEP] instead, the [SEP] + +===== sample 022 ===== +[CLS] 1. 5 - game run. [SEP] in 2004, chicago - based boston pitchers hit jason varitek three times. [SEP] he had been jailed in october 2007 for six months, and before he was last seen near his family home in parkville, n. j., he was drunk during his break - in. [SEP] last week darling announced that the public debt - - which includes roads, playgrounds, super - schools, universities, schools, hospitals, hospitals, high - rises and roads - - would be repaid by the end of the year. [SEP] the team is one of the best teams on the planet. [SEP] [SEP] + +===== sample 023 ===== +[CLS] million. [SEP] " when i'm not there, it's not about winning, it's winning. [SEP] at the time, the young man wore a jumper with his short - sleeve shirt, and a dark shirt, bottoms and bottoms. [SEP] father phillips, 67, said that he had already seen his wife, and that in a marriage he's had 50 years and 10 children. [SEP] there is no connection between reading and high school scores. [SEP] meanwhile, the u. s. foreign relations office is doing so in line with international court rules. [SEP] i don't need anything. [SEP] the electoral process has [SEP] + +===== sample 024 ===== +[CLS] part of the couple's life - - a three - way, four - year relationship. [SEP] when i've had a break - - i would want to take one other out, but i'm not alone - - i always get depressed. [SEP] switzerland, and swiss banks in particular, has a lot of the money flowing. [SEP] he also said that it was important to have the support of all people. [SEP] i have to believe that we should start talking to the world. [SEP] by the time we came round, the doors were open. [SEP] but nobody has thought of a full sit - down, or even a [SEP] + +===== sample 025 ===== +[CLS] that they are to be well informed and that message is very strong, "he said. [SEP] he said then," i know it is the day of the game and it was particularly important and would have been a good start. [SEP] and maybe he wasn't funny, but people think he was real. [SEP] by the start of the 2004 presidential campaign - - just a three months - - he was on the need to talk with americans about his patriotism. [SEP] but don't expect a panic. [SEP] he doesn't understand where you are, "he said. [SEP]" i find it hard to make the most [SEP] + +===== sample 026 ===== +[CLS] smashed glass windows in his home. [SEP] "it could be said that when we're not going to do something - - we don't know, we're going to do something - - we can have a better life. [SEP]" i really wanted to do something, i love it because i thought twice about you, that kind of really about what i can do. [SEP] he says he paid $10, 000 and sold the tickets for $800, but he was able to get out of the room. [SEP] "they are the people who would have been a small part of that," hairston said. [SEP] [SEP] + +===== sample 027 ===== +[CLS] crack down on the quality of their players. [SEP] smith, however, remains optimistic. [SEP] "it's hard to call some of the facilities part of a return to old days," he said, as a man waited in the new president's office at the palace. [SEP] you can just take a flight from the office and then get a job, a salary or a couple of dollars to make a visit. [SEP] i knew i had to live in my own well - lit tent, an out - of - town place and a place to go in. [SEP] however, we've got a lot of people having to [SEP] + +===== sample 028 ===== +[CLS] m. c. a. tournament. [SEP] u. s. troops killed in iraq in 2007 dropped up to 38 at the start of this year, according to the pentagon's statement. [SEP] i am a college student because i have lived all my life. [SEP] now, that's a small group. [SEP] hours after the team's president announced his decision on thursday night, the knicks protested and asked thomas to not sign his contract and had no comment. [SEP] but if that's enough to stop that change, it has yet to be approved. [SEP] " it's fair to say there is a huge part of [SEP] + +===== sample 029 ===== +[CLS] return at home. [SEP] for example, the western state of england is thought to have the largest share of the population of 11 percent. [SEP] "the allegations are untrued," he says. [SEP] in the ruling, mr justice weir said: " mr mcnulty immediately went to the office of justice and provided his details to the tax office, the revenue commissioner, the irs, the treasury secretary, the attorney general and the u. s. department of justice to help to provide financial services in the uk. [SEP] we've done it. [SEP] the two are also likely to focus on the need for political settlement [SEP] + +===== sample 030 ===== +[CLS] his own close relationship with his old england manager. [SEP] "the road can get to the end. [SEP] he has been known to move in the past few months. [SEP]" immediately after the blast, we had a very difficult effort to get our eye out of the area. [SEP] "we'd be talking about how you can't go over there, which i don't know, that kind of thing, you know, that was," mr. jordan said. [SEP] it's hard to believe, people. [SEP] but it may not come until the end of the year. [SEP] but in truth, i had [SEP] + +===== sample 031 ===== +[CLS] sunday's event. [SEP] ", however, the misunderstandings on this issue have to be addressed, " the officials said. [SEP] still, the loss of a loan, which is made for them by their lenders, is not enough of a reason to let go. [SEP] it is also expected that a number of measures will be made to turn around the world economy. [SEP] about a third of the country's 2 million children and their families are estimated to be poor, most of them due to poverty. [SEP] we have all been in it for too long, but we have to put up our best ideas. [SEP] the [SEP] + +===== sample 032 ===== +[CLS] need to put this money on their tax bill by now, and that isn't quite much down at the end of 2011. [SEP] in a study from 2004 to 2008, the percentage of female child victims increased slightly to just 2. 3 percent. [SEP] i was born long before i was done. [SEP] they haven't done it. [SEP] he can't live to lose. [SEP] he's got a good game, and he does it well. [SEP] "i would say it was a good start to make decisions for you," he said. [SEP] i don't really think that we didn't want to [SEP] + +===== sample 033 ===== +[CLS] and italy. [SEP] finally, instead of watching, i had to go to the weather office to check up for the next morning. [SEP] "the market to build a market is going to be built in a kind of way. [SEP] he told the newspaper in the days before the murder trial that he had no regrets and would not fight the charges. [SEP]" i don't think you should be allowed to talk about it, but i'm not very happy, "he said. [SEP] on saturday, he was attacked with another woman in the force area. [SEP] but that does not happen. [SEP]" there didn't be [SEP] + +===== sample 034 ===== +[CLS], 50 years in a row, to seven games. [SEP] the woman is about 5ft 6in tall (4. 8m, 11. 4m). [SEP] he is there, exposing syonies, making repeated gestures at them, biting them, and raping them hideously. [SEP] even before he had a good season with the yankees, the team was dominant. [SEP] the house of commons, the upper chamber, has used the two - thirds majority to bring in 21 seats. [SEP] " you have to come back to me and have a conversation with me and i want to win. [SEP] i don't think [SEP] + +===== sample 035 ===== +[CLS] the first time sunday. [SEP] "i knew that i wanted to be able to be there," rodriguez said in a statement. [SEP] "if they didn't have that kind of money, then it wouldn't happen at all," mr horsin said. [SEP] "the door is no longer open," she said. [SEP] ms. bork, 53, and her son, austin, have developed an interest in state - funded insurance companies. [SEP] but that strategy seemed to work well with him. [SEP] 27/prnewswire/- - raytheon corporation (nyse: dn), [SEP] + +===== sample 036 ===== +[CLS] it seemed to take a while to get me started, so i wanted to start the game. [SEP] but it was set up by government and international organizations that also supported the project. [SEP] for many people, ailing has worked as a relief. [SEP] there's always an ideal world where you have to grow into your own. [SEP] "she was so excited," kroe said. [SEP] but when i say about it, you tell me what i want, and then there will be a large cup of sweet tea. [SEP] " i think he's going up and down, ' if we don't do that [SEP] + +===== sample 037 ===== +[CLS], which is not easy from the field. [SEP] that is enough in the case of a permanent new home. [SEP] he said that there appeared to be a chance that this year's budget might recover in time for the presidential election in january. [SEP] it's not something we have got to do in a big way. [SEP] "i don't have to have fun," he said, " but it would be a situation i can remember, and i would be the only one who may not want to know... [SEP] he took his first order out of his business. [SEP] dallas, texas (ap) - [SEP] + +===== sample 038 ===== +[CLS] 1 million, or 5. 3 percent, to $2. 377 a share, while second - quarter revenue, which declined by $3. 2 billion, or 3. 4 percent, declined. [SEP] "ultimately i wanted to know what it was like to be a footballer - - i felt i thought he would work for me in my life," said mr hill. [SEP] there have been three other changes to be in the squad. [SEP] the yemen - based al jazeera al - fitr al - e - aq al - islami group said more than 150 people have died so far in the country ' [SEP] + +===== sample 039 ===== +[CLS] nothing to stop the crime. [SEP] in reality, there has to be an attempt to sell the club to a manager who has little to offer, but he has nothing to talk about and that he would have to fight for a new job. [SEP] but in the case of the pope and the pope, there is a different view of the world, " he said. [SEP] some 2, 000 businesses were bailed out at the end of 2007, compared to more than 3 million. [SEP] the team's 6 - 3 road loss was only the knicks' sixth road win. [SEP] young, of north carolina high school, said he [SEP] + +===== sample 040 ===== +[CLS] and the rest of obama's visit, either in washington, or over the weekend. [SEP] but i have paid the cost to a hospital, bank and insurance agency. [SEP] but that is to be the outcome of this super - big question. [SEP] "life will not be easy, unless you allow your children to run from school. [SEP] but he said that a full trial for those two would be a significant boost to the children's case. [SEP] it's a way of being done, and i'm happy," he said. [SEP] " this is a very good case for making sure whether we should be allowed [SEP] + +===== sample 041 ===== +[CLS] to cars, hotels, food, and even handouts, "he says. [SEP] i'll go on a sort of sled (i like the show) and feel guilty. [SEP] it was the sort of situation we're getting ourselves in - - we just put a couple of hoops and games in our heads. [SEP] we'd never had a bit of what happened," he said. [SEP] " there are no guarantees that there will be as much change... as we expected - - but i have an idea of it happening. [SEP] the number will probably grow to about 100, 000 in the next [SEP] + +===== sample 042 ===== +[CLS] the news is over again, leaving him without a foot on the car. [SEP] and the answer never got to the end. [SEP] i was aware that my mind changed on the day when i arrived, that the woman had given access to me and all of the people. [SEP] that's interesting. [SEP] if i wait for 15 minutes before a concert, i will see him again (i'm sure i'll listen). [SEP] it's a short - term problem, and it's never going to make it to a big game, "he said. [SEP]" we believe some of the things we found to [SEP] + +===== sample 043 ===== +[CLS] [SEP] "i love the public option, but it's never been in the hospital, the brain, or the classroom," she said. [SEP] we would, well, turn the focus for years on the president. [SEP] of course, they will be allowed to claim "they take a year's leave" for charity, or "try to make money" for trying to buy a property on a scale which they think is "fair tax." [SEP] marshall's attorney, stephen heine, said there is a lot of work to do on toe - to - toe litigation - - no one knows where the matter is [SEP] + +===== sample 044 ===== +[CLS] 2010. [SEP] "it is very sad, really, because sometimes you feel like you don't be careful and that's what it takes to be successful," she added. [SEP] four other vessels, including hundreds of crew members, were also also aboard. [SEP] in fact, they came with a host of different colors, from green dustwhies to rashes and the white redness of the brain's tissues. [SEP] i don't want to win, but i'm on the other end. [SEP] i still want to finish school, even though i don't plan to leave. [SEP] the national [SEP] + +===== sample 045 ===== +[CLS]'s funny, but it's ridiculous, "clinton told reporters on a flight from chicago to new york. [SEP] we always get the loose ball, so the result is very good. [SEP]" i want to try to score more. [SEP] it didn't happen until the start of the season. [SEP] we're going to see that happen again. [SEP] in the past year, there have been reports of attacks, which rose to more than 1, 100 in 2008. [SEP] "it's a day to talk to the world," he said. [SEP] the male driver of the car - - robert james, 32 [SEP] + +===== sample 046 ===== +[CLS] willingness to step in to the public sphere. [SEP] you're just right, there's a lot to work out for you. [SEP] it is unlikely the next deal is due to be signed soon, because the costs are so high. [SEP] i know the first time i'm not sure i'm not going to make this happen to me, but at least i've thought of myself. [SEP] as good as it sounds, he wants to go to high school, but that is still to go, a long way to go on a full - term career in virginia. [SEP] even though he's done much of [SEP] + +===== sample 047 ===== +[CLS] they can make journeys between home and overseas. [SEP] meanwhile, cleveland's james brown and the celtics' kevin garnett offered a sort of push for the nba title. [SEP] i am sure it looks like people will be dead at the end of their lives, " she said. [SEP] 9 (upi) - - a study by u. s. health department officials found health systems in three states have a relatively high level of swine flu. [SEP] atlanta pushed the lead to 28 - 30 at the half - - including three of their nine 3 - pointers, including 4 - 1 1/2 minutes into the fourth [SEP] + +===== sample 048 ===== +[CLS] work relations and family relations. [SEP] the problem is very real. [SEP] the fate of the plant's owner, a nuclear official, is not to be known, but will be a critical component when the company reports at the start of the new year. [SEP] it also emerged that the victim did not know the government was ever involved in the case. [SEP] however, there is little time to go to work and create a new team. [SEP] i'm sorry, but i do think it's important to read the whole story. [SEP] when i woke up, there was a restlessness of numbness, which was my reaction [SEP] + +===== sample 049 ===== +[CLS] confident that the president's power would be used to protect the president's health, "he wrote in remarks to reuters. [SEP] but the prime minister said she wanted to be reunited in the hands of a different administration. [SEP] i was there a few minutes later, looking very nice and he was having a lot of staches this time... [SEP] and so, i was much more concerned with the idea of a permanent solution to the problem of nuclear proliferation. [SEP] a spokesman said:" " i think we need to account for the payouts but we do not think we will get a deal when we go. [SEP] + +===== sample 050 ===== +[CLS] she added. [SEP] if this really was a problem... we don't need one to make a reference to the "nature of iran's nuclear program" (and israel) that has nothing to do with u. s. policy, but we cannot wait for the west to do that now.... [SEP] "we would come in, give them a good chance and make it a win, so if we were going to make a change, then we would take it later," he says. [SEP] a good place to make money? [SEP] the second step would be to replace the 47 - year - old [SEP] + +===== sample 051 ===== +[CLS] a lender has to take a credit - card account. [SEP] but the organisation's appeal comes only two weeks after thousands of people killed or injured in violence. [SEP] "the president will get out of the way again, he can find what he knows a bit, what to get in there," he said. [SEP] and that is not a great result. [SEP] if you are playing for the australian team you will probably have to wait for the opportunity. [SEP] but that has not happened in mexico, and the authorities expect them to be able to contact the rest of the population. [SEP] it is not unusual for me to think [SEP] + +===== sample 052 ===== +[CLS] points. [SEP] he has refused to disclose the details of the scope of his investigation, but insisted that he did not know the nature of the risk he would be released in prison for life. [SEP] a spokesman for the school system could not immediately be reached. [SEP] going to haiti was, well, not - for - a - goal. [SEP] in her life, he said, the girls seemed to have sex when they had no choice. [SEP] i don't let the doctor tell your friend, friend or brother, the money you make when you feel stupid is to make the money. [SEP] there's some things to look into [SEP] + +===== sample 053 ===== +[CLS]. [SEP] the two had offices, conference facilities and apartment buildings, and that could not be confirmed. [SEP] a surprise decision to replace india's toyota as the world's largest automaker has lost millions of jobs. [SEP] he's a democrat, he's built into a business. [SEP] no working group has been able to raise this amount, but at least he's been able to do it. [SEP] the official said the executive committee at the end of the summit has been working with the u. s., russia and china to make a case against the move. [SEP] the meeting took place as early as a [SEP] + +===== sample 054 ===== +[CLS] something we didn't want, "he said. [SEP] officials said the driver left shortly after the crash and was allowed to leave for the morning shift. [SEP] the best way for them is make sure they do not keep it safe. [SEP] so it's not a bad start. [SEP]" that could give me problems, " he said. [SEP] at the end of the year, that number will be about 13. [SEP] we have to use the opportunity to try to change the past and find the way to the future. [SEP] i, however, have a little connection with mr. nader....... [SEP] + +===== sample 055 ===== +[CLS] "i was going to see one of them, not going to see that one" at a time, he said. [SEP] "if there's something that is going to be done, and we've all agreed that we'll be able to take it, i think there's something we can do," scurry said. [SEP] i guess we are trying to change that. [SEP] ryan smyth's goal tied the scoreless at 2 - 2 with 3: 05 left in the first. [SEP] more than 1, 200 people were injured in the crash, which killed 13 people between 2004 and 2006. [SEP] [SEP] + +===== sample 056 ===== +[CLS] don't think it is going to be like having make - up cheques in your car. [SEP] but if he's right, he's a coward. [SEP] and, well, well, we're going to know he's dead... and we don't have too much for him in jail. [SEP] "i don't like to be the wrong person, but i think it's her job to be honest," she said before t. o. c. asked if her life had changed. [SEP] this is expected to total approximately $50 million in 2008 - 2010. [SEP] it [SEP] + +===== sample 057 ===== +[CLS] and we regain their independence. [SEP] john leahy, head of securities brokers, said the company's results have helped investors to focus on their options given the current economic environment. [SEP] "i usually have a job with a large group, where i have to do a job, sometimes for at least a year to a year," he said. [SEP] " it would be a political stunt. [SEP] the heat won two games in the series, which ended after the season started going 2 - for - 5. [SEP] the pirates took off with a two - 0 run. [SEP] i cannot also look at other activities here. [SEP] [SEP] + +===== sample 058 ===== +[CLS] may have to pay other costs for their homes. [SEP] the family said they were trying to get a lawyer. [SEP] he was expected to return from his holiday when he returned to britain at the end of april. [SEP] associated press writer suna deby in nairobi, kenya contributed to this report. [SEP] when we focus on each other, we have a different response in which we respond to all of our problems. [SEP] after all, we have no jobs. [SEP] he retired at the end of the season in his second year in less than a year with the new york jets but he hasn't been with the packers. [SEP] he [SEP] + +===== sample 059 ===== +[CLS], we now have a focus on what we have to do. [SEP] that said, if you want to convene his position at this point he'll make a decision at this point to take stock in the company. [SEP] however, both companies have been forced to change the law to try to protect themselves against the recession. [SEP] she's only 18 years old, and she's over four years. [SEP] it is still running out of money and just doesn't seem to know much. [SEP] "i'm confident the next president will resolve the problem," he said. [SEP] that's what we need [SEP] + +===== sample 060 ===== +[CLS] co. [SEP] the border wall, which stands out on a concrete strip on the other side of the border, is now closed. [SEP] that's pretty much in itself. [SEP] it was a lot of fun. [SEP] it would have been easier to write off. [SEP] overtime _ 2, detroit, min, min (hooking), 17: 08 roy, min (hooking), 18: 08. [SEP] associated press writer anne gearan in washington contributed to this report. [SEP] "the rest of the tour is all i can and it forces me to get back and get the race there," she said. [SEP] [SEP] + +===== sample 061 ===== +[CLS] the game - clincher at 2 - 3, scored on a power play just 22 minutes in the second period. [SEP] they may have turned his face on the subject, put in an interview and, with a smile, focused for days on the image of himself in the face. [SEP] " we are used to the leadership of the army. [SEP] i only was able to walk when i was in the middle of the night and thought i could have been standing in the tunnel. [SEP] donaghy said the league's decision does not comment on its decision. [SEP] his father reportedly died in december. [SEP] after india's elections [SEP] + +===== sample 062 ===== +[CLS] home to a home with her 7 - year - old son. [SEP] the letters were only "written in the united states," according to national intelligence officials. [SEP] for that part of the day, president obama, who felt he had to make another big shift in the campaign, was a little far from in the right position for the region. [SEP] "he needs to be a better for the team," said a source. [SEP] last year he issued 2, 035 orders in january. [SEP] the shows will air on the discovery channel and other shows next year. [SEP] it may seem to me at the top of this table [SEP] + +===== sample 063 ===== +[CLS] iraq, according to a recent report in the post. [SEP] mr. sandro is left by the end of the story, leaving him in the car, going off for hours - if not minutes - - in his hands. [SEP] "we are looking for a long - term extension of this strategy. [SEP]" our differences are great and i do not want to be alone. [SEP] "i know, the first time he started it, i would tell him to take him, it was always hard to pick a player after him, so i don't know if he could make up his mind. [SEP]" i don't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/state_c256_t1p45_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/state_c256_t1p45_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..605679bde5b01199bb6a2aa830a321f3ba5668cf --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/state_c256_t1p45_raw_samples.txt @@ -0,0 +1,228 @@ +state_c256_t1p45 +{ + "type": "summary", + "name": "state_c256_t1p45", + "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", + "step": 124000, + "decode": { + "kind": "categorical_fullvocab", + "config": "state_c256_t1p45", + "steps": 256, + "model_t_mode": "post", + "support_power": 1.0, + "semantic_power": 1.0, + "endpoint_temp": 1.45, + "concentration_min": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 29.81545187350111, + "nll_per_token": 3.3950267783717107, + "tokens": 9500 + }, + "diversity": { + "sample_entropy": 4.085741040367163, + "unique_tokens": 1473, + "token_count": 8192, + "distinct_1": 0.1798095703125, + "distinct_2": 0.5905511811023622, + "top_token_mass": 0.0538330078125 + } +} + +===== sample 000 ===== +[CLS] press reported. [SEP] i would have to cancel a couple of flights, but i was free to go... [SEP] the project, costing £1, 500, will make it possible to bring some of the world ' s best teams to the uk. [SEP] we ' re going to have an investigation that, with all our evidence, we have never seen before, " he added. [SEP] the carmaker ford lost $ 60m in the first quarter alone. [SEP] " there is a real need for transparency. [SEP] the scale of the devastation has been driven by the displacement and reshaping of nearly 10, 000 people around the world [SEP] + +===== sample 001 ===== +[CLS] - trade plan. [SEP] in the past, we have looked back at some ways, and i think the problem is, we did not get this far. [SEP] " i think, ' john, i think he ' s ok, but i ' m not really in a position to talk to you. [SEP] " it was a little bit of a big fight and we had to be aware of it, " said the german. [SEP] for a moment, the place, if you kind of look out, seems to sit in perspective. [SEP] when a discussion of the president ' s fate actually takes place, so many of those who know [SEP] + +===== sample 002 ===== +[CLS] the white house, " he says. [SEP] i ' ve never known there has been a huge factor in the game. [SEP] he likes to get up, but a little bit well, and just works well in the gym. [SEP] " i think we have to get a good deal, so if the result is a win, the majority is in danger of losing, " ender said. [SEP] " the idea is to get the money they want to get, and we ' re not able to make money, " added schbutter. [SEP] the police have said that they were investigating more than a dozen complaints. [SEP] but [SEP] + +===== sample 003 ===== +[CLS] quite the way we are. [SEP] i just hope that i can do it again. [SEP] he says that he doesn ' t think he should talk to anyone trying to sell himself. [SEP] you know we ' ll take our lessons, " said the foreign official. [SEP] i ' ve liked one one, i like the other, and of course he has to deal with this if he is a candidate when he gets into it. [SEP] " there are also things you want to do with that work, such as getting dressed in white clouds, or capels, or even a black scarf, " he added. [SEP] a government agency investigating [SEP] + +===== sample 004 ===== +[CLS] : " the total of stolen items includes a number of personal items including household goods, airbags and computers. [SEP] " i don ' t think it was until my 70s that i really got into trouble, " he said, " i can ' t make it much better - - i didn ' t even have a talking point. [SEP] officials from around the world and more than a 100 other countries attended the event. [SEP] while he is so popular in the united states, he is critical of his free - trade policies in the u. s. and calling for the collapse of the union. [SEP] the production also features a three - [SEP] + +===== sample 005 ===== +[CLS] guide them to the democratic nomination. [SEP] " i ' ve got quite a concern about the number of people who have worked and the number of people who have been working and thought about the quality of things that are done or if they have been worked out. [SEP] " we don ' t want to know that he can play in the future, " said peter westbrook, the club ' s assistant coach. [SEP] it was last updated at 20. 54 bst on thursday 16 may 2009. office for the city of london. greater london, south london. £36, 624 to £43, 000 per annum. [SEP] he [SEP] + +===== sample 006 ===== +[CLS] air crash in rome, witnesses said. [SEP] " i ' ll do that and i ' m glad this has been resolved. [SEP] since the 10th century, the u. s. government has never been part of iraq. [SEP] it said that after several days the children, who would be temporary workers who did not see their parents for another six weeks, would not receive full visas and would be free from their work. [SEP] i just wanted to let him stand up and try to get here, " according to the eca. [SEP] the nets also scored 13 of his 15 points in 20 minutes - - he had 16 rebounds in the [SEP] + +===== sample 007 ===== +[CLS] in a series of federal deficits and budget shortcomings. [SEP] i mean, if you ask me to look at you, you ' re a celebrity, it ' s just hard to imagine. [SEP] a 19. 1 share in california ' s unemployment report, down slightly in chicago in august. [SEP] in the end, the swiss group had to set a compensation deal with the government and was promised the full compensation of the bank ' s 5, 000 employees. [SEP] so it ' s not been easy for him, as we both know the rules. [SEP] the first game of the series was 14 - point loss to detroit. [SEP] + +===== sample 008 ===== +[CLS] 57. 7 million. [SEP] i believe that they will not be able to pay the cost. [SEP] " if we ' ve got a team where we are up to the task, we want to do it in terms of our commitment to football, " barca said. [SEP] what has been the challenge for children to learn from the past? [SEP] mr brown said the leaders had all agreed on a get - in for the couple. [SEP] on wednesday, the protesters sent riot police, police trucks, fire engines and soldiers on their way to the stadium for a second time. [SEP] the group is led by john bord. [SEP] but [SEP] + +===== sample 009 ===== +[CLS] their vehicles. [SEP] still, it took them four years to achieve the first cut in the government ' s funding in three years and start to the school year. [SEP] we ' ve told them. [SEP] the victims collected up to $ 20, 000 in cash, cash, cash, cash, cigarettes and cash, police said. [SEP] " when we get down to the final i think it ' s something that we have been trying to do for a long time for us. [SEP] " it ' s just a small number to look for, it ' s not true, " she said, " " well, i don ' t need [SEP] + +===== sample 010 ===== +[CLS] - - " he joked. [SEP] " this announcement is a response to the lack of public funding, " said a spokesman of the children of education committee. [SEP] however, as a result, i think i ' m in the right mood. [SEP] clinton has said the us will help to improve the political situation in zimbabwe. [SEP] we ' ll see. [SEP] and it is a great thing to help them in the day and help them in a good way. [SEP] on the other hand, one thing is to overcome this fear and prejudice. [SEP] another £1 million a year has also gone into the children ' s education fund, which has [SEP] + +===== sample 011 ===== +[CLS] in front of others. [SEP] it just seems to pick up the air of the wind. [SEP] boca raton, fla., march 3 ( upi ) - - owners of u. s. retailers said they expect to be down by as much as 10 percent in the second half of 2008, a survey said. [SEP] he lives in chicago. [SEP] he said there was no sign the club was going to replace him, so there was none of them to replace him. [SEP] the court heard the ex - president was staying at home, four years after losing the presidency in 2001. [SEP] on friday, senate republican leader john [SEP] + +===== sample 012 ===== +[CLS] weekend, said he was " tired " and had " nothing to do " with a run that was " normal " after he started. [SEP] i had the message being, " don ' t talk about you anymore. " [SEP] i have sex every day, every 20 - year - old girl loves it. [SEP] you ' re always looking to pick up a job of your own or make some money, but there ' s a lot of work to get in. [SEP] where are your best friends? [SEP] i ' m sure that he ' s the guy who can have the things we want, have the things that i can trust, [SEP] + +===== sample 013 ===== +[CLS]. s. kabul, afghanistan ( ap ) - - a roadside bomb ripped through an eastern afghan town wednesday, killing a dozen people and wounding 24 others, including three children, and a schoolgirl, provincial police and officials said. [SEP] until then, at least it hadn ' t come to saturday ' s conclusion. [SEP] " no one will be responsible for the breach of security, " he added. [SEP] the safety condition of the two - lane scat would be set in proportion to a narrow exit where the driver of a car on the other side would hit the driver ' s hand, causing the driver to be stuck. [SEP] [SEP] + +===== sample 014 ===== +[CLS] " said mohammed. [SEP] he is so fast - - and yet he sees, at first, the freshness of the light and the warmth of the all - around sun that brought him down from the moon to earth. [SEP] we still don ' t know. [SEP] " you don ' t always know what you ' re going for. [SEP] " it ' s hard to see, it ' s hard to take out anything that ' s important at all, " she says. [SEP] " we did have more problems, " said coach scott brown, a member of the nfl players ' association. [SEP] " the president and manager, all [SEP] + +===== sample 015 ===== +[CLS] of the children. [SEP] they won ' t be able to see you, but we better know them if they don ' t put their money on a table. [SEP] i don ' t know. [SEP] that used to be fine on the street, but with the doors closed and the busses running from front to back streets, it didn ' t go that far. [SEP] in the early 2000s, however, rates were sharply lower. [SEP] " there ' s a lot of work going on, and it was not wrong, " he said. [SEP] " i ' ve just got a little bit of a fight. [SEP] since then, [SEP] + +===== sample 016 ===== +[CLS] said. [SEP] similar turbines are being built in the uk, but needs to be completed by 2013, said a senior government official involved in the talks. [SEP] he made 25 of 32 shots from the field before punting on 3 - of - 13 three - goal attempts saturday night in the wild 1 - 0 loss to san jose city, the first victory of the season a day earlier. [SEP] there ' s a problem that can seem to cause any amount of mental pain, " said kitz. [SEP] we must change our perception, and without any change, we must still make a lot of mistakes, and act fast, and we [SEP] + +===== sample 017 ===== +[CLS] to obama ' s visit to america in june, that he seemed to understand that he really was going to behave in different conditions. [SEP] there is such a sense of optimism and change for you, according to cbs / kland. com. [SEP] it would be in good faith. [SEP] " that ' s not necessarily what we ' re about. [SEP] that ' s a good thing, it ' s kind of a joke. [SEP] wake up and drop the story for comment. [SEP] " we believe that we still have the ability to win, " said mr brown. [SEP] new york - kirilenko scored 26 points and jason terry [SEP] + +===== sample 018 ===== +[CLS] in the first quarter of december 2007. [SEP] the u. s. c. arrived at the air station at about 8 a. m. and returned immediately, according to one person with knowledge of the condition of monday ' s departures. [SEP] the president has gotten the message quickly and cautioned citizens to be on alert. [SEP] capello ' s team could play against the united states in this week ' s group stage, and italy has three games in the final, but it ' s not. [SEP] then, however, we moved into the middle of a relationship. [SEP] lake city, ill. - - the man who killed [SEP] + +===== sample 019 ===== +[CLS] confirmed his move to rangers on tuesday and are due to start their european campaign in the light of the first game of chelsea ' s trip to ibrox. [SEP] the trial was scheduled to take place in 2009. [SEP] we ' re not doing enough - - we will get that fast if we can go. [SEP] for example, the concept of a low - end car could go on the road. [SEP] " i ' m concerned that we will have a new set of rules that we have to sort out, and there will be more changes in financial financial systems over the couple of years, " he said. [SEP] the capital, [SEP] + +===== sample 020 ===== +[CLS] person familiar with the matter. [SEP] new york ' s health insurance program is designed to inflate financial costs. [SEP] it took only a few minutes to develop. [SEP] at that time, in february 2008, the percentage of people paying a 10 - year mortgage rose this year from 13 % to 3. 8 %. [SEP] they let us do nothing in the past. [SEP] " we don ' t talk about a financial crisis, it ' s just getting people together, " he added. [SEP] but the goal is to make up for the fire that is coming in markets that are getting stressed, including mortgage - backed securities, which [SEP] + +===== sample 021 ===== +[CLS] still lives, and he knows how to make a living. [SEP] the council has provided £5, 000 to cover the building and £5, 000 to design, with the rest still to be added. [SEP] it is really hard for him to see anything in a way. [SEP] the mets are trying to add santana, for example, who is looking for a good season. [SEP] then she dropped off her clothes. [SEP] he is still trying to keep a lead while even keeping the ball in playoff games. [SEP] the union said it represents more than 2, 000 temporary workers, and that drivers would have to work overtime. [SEP] instead, the [SEP] + +===== sample 022 ===== +[CLS] 1. 5 - game run. [SEP] in 2004, chicago - based boston pitchers hit jason varitek three times. [SEP] he had been jailed in october 2007 for six months, and before he was last seen near his family home in parkville, n. j., he was drunk during his break - in. [SEP] last week darling announced that the public debt - - which includes roads, playgrounds, super - schools, universities, schools, hospitals, hospitals, high - rises and roads - - would be repaid by the end of the year. [SEP] the team is one of the best teams on the planet. [SEP] [SEP] + +===== sample 023 ===== +[CLS] million. [SEP] " when i ' m not there, it ' s not about winning, it ' s winning. [SEP] at the time, the young man wore a jumper with his short - sleeve shirt, and a dark shirt, bottoms and bottoms. [SEP] father phillips, 67, said that he had already seen his wife, and that in a marriage he ' s had 50 years and 10 children. [SEP] there is no connection between reading and high school scores. [SEP] meanwhile, the u. s. foreign relations office is doing so in line with international court rules. [SEP] i don ' t need anything. [SEP] the electoral process has [SEP] + +===== sample 024 ===== +[CLS] part of the couple ' s life - - a three - way, four - year relationship. [SEP] when i ' ve had a break - - i would want to take one other out, but i ' m not alone - - i always get depressed. [SEP] switzerland, and swiss banks in particular, has a lot of the money flowing. [SEP] he also said that it was important to have the support of all people. [SEP] i have to believe that we should start talking to the world. [SEP] by the time we came round, the doors were open. [SEP] but nobody has thought of a full sit - down, or even a [SEP] + +===== sample 025 ===== +[CLS] that they are to be well informed and that message is very strong, " he said. [SEP] he said then, " i know it is the day of the game and it was particularly important and would have been a good start. [SEP] and maybe he wasn ' t funny, but people think he was real. [SEP] by the start of the 2004 presidential campaign - - just a three months - - he was on the need to talk with americans about his patriotism. [SEP] but don ' t expect a panic. [SEP] he doesn ' t understand where you are, " he said. [SEP] " i find it hard to make the most [SEP] + +===== sample 026 ===== +[CLS] smashed glass windows in his home. [SEP] " it could be said that when we ' re not going to do something - - we don ' t know, we ' re going to do something - - we can have a better life. [SEP] " i really wanted to do something, i love it because i thought twice about you, that kind of really about what i can do. [SEP] he says he paid $ 10, 000 and sold the tickets for $ 800, but he was able to get out of the room. [SEP] " they are the people who would have been a small part of that, " hairston said. [SEP] [SEP] + +===== sample 027 ===== +[CLS] crack down on the quality of their players. [SEP] smith, however, remains optimistic. [SEP] " it ' s hard to call some of the facilities part of a return to old days, " he said, as a man waited in the new president ' s office at the palace. [SEP] you can just take a flight from the office and then get a job, a salary or a couple of dollars to make a visit. [SEP] i knew i had to live in my own well - lit tent, an out - of - town place and a place to go in. [SEP] however, we ' ve got a lot of people having to [SEP] + +===== sample 028 ===== +[CLS] m. c. a. tournament. [SEP] u. s. troops killed in iraq in 2007 dropped up to 38 at the start of this year, according to the pentagon ' s statement. [SEP] i am a college student because i have lived all my life. [SEP] now, that ' s a small group. [SEP] hours after the team ' s president announced his decision on thursday night, the knicks protested and asked thomas to not sign his contract and had no comment. [SEP] but if that ' s enough to stop that change, it has yet to be approved. [SEP] " it ' s fair to say there is a huge part of [SEP] + +===== sample 029 ===== +[CLS] return at home. [SEP] for example, the western state of england is thought to have the largest share of the population of 11 percent. [SEP] " the allegations are untrued, " he says. [SEP] in the ruling, mr justice weir said : " mr mcnulty immediately went to the office of justice and provided his details to the tax office, the revenue commissioner, the irs, the treasury secretary, the attorney general and the u. s. department of justice to help to provide financial services in the uk. [SEP] we ' ve done it. [SEP] the two are also likely to focus on the need for political settlement [SEP] + +===== sample 030 ===== +[CLS] his own close relationship with his old england manager. [SEP] " the road can get to the end. [SEP] he has been known to move in the past few months. [SEP] " immediately after the blast, we had a very difficult effort to get our eye out of the area. [SEP] " we ' d be talking about how you can ' t go over there, which i don ' t know, that kind of thing, you know, that was, " mr. jordan said. [SEP] it ' s hard to believe, people. [SEP] but it may not come until the end of the year. [SEP] but in truth, i had [SEP] + +===== sample 031 ===== +[CLS] sunday ' s event. [SEP] ", however, the misunderstandings on this issue have to be addressed, " the officials said. [SEP] still, the loss of a loan, which is made for them by their lenders, is not enough of a reason to let go. [SEP] it is also expected that a number of measures will be made to turn around the world economy. [SEP] about a third of the country ' s 2 million children and their families are estimated to be poor, most of them due to poverty. [SEP] we have all been in it for too long, but we have to put up our best ideas. [SEP] the [SEP] + +===== sample 032 ===== +[CLS] need to put this money on their tax bill by now, and that isn ' t quite much down at the end of 2011. [SEP] in a study from 2004 to 2008, the percentage of female child victims increased slightly to just 2. 3 percent. [SEP] i was born long before i was done. [SEP] they haven ' t done it. [SEP] he can ' t live to lose. [SEP] he ' s got a good game, and he does it well. [SEP] " i would say it was a good start to make decisions for you, " he said. [SEP] i don ' t really think that we didn ' t want to [SEP] + +===== sample 033 ===== +[CLS] and italy. [SEP] finally, instead of watching, i had to go to the weather office to check up for the next morning. [SEP] " the market to build a market is going to be built in a kind of way. [SEP] he told the newspaper in the days before the murder trial that he had no regrets and would not fight the charges. [SEP] " i don ' t think you should be allowed to talk about it, but i ' m not very happy, " he said. [SEP] on saturday, he was attacked with another woman in the force area. [SEP] but that does not happen. [SEP] " there didn ' t be [SEP] + +===== sample 034 ===== +[CLS], 50 years in a row, to seven games. [SEP] the woman is about 5ft 6in tall ( 4. 8m, 11. 4m ). [SEP] he is there, exposing syonies, making repeated gestures at them, biting them, and raping them hideously. [SEP] even before he had a good season with the yankees, the team was dominant. [SEP] the house of commons, the upper chamber, has used the two - thirds majority to bring in 21 seats. [SEP] " you have to come back to me and have a conversation with me and i want to win. [SEP] i don ' t think [SEP] + +===== sample 035 ===== +[CLS] the first time sunday. [SEP] " i knew that i wanted to be able to be there, " rodriguez said in a statement. [SEP] " if they didn ' t have that kind of money, then it wouldn ' t happen at all, " mr horsin said. [SEP] " the door is no longer open, " she said. [SEP] ms. bork, 53, and her son, austin, have developed an interest in state - funded insurance companies. [SEP] but that strategy seemed to work well with him. [SEP] 27 / prnewswire / - - raytheon corporation ( nyse : dn ), [SEP] + +===== sample 036 ===== +[CLS] it seemed to take a while to get me started, so i wanted to start the game. [SEP] but it was set up by government and international organizations that also supported the project. [SEP] for many people, ailing has worked as a relief. [SEP] there ' s always an ideal world where you have to grow into your own. [SEP] " she was so excited, " kroe said. [SEP] but when i say about it, you tell me what i want, and then there will be a large cup of sweet tea. [SEP] " i think he ' s going up and down, ' if we don ' t do that [SEP] + +===== sample 037 ===== +[CLS], which is not easy from the field. [SEP] that is enough in the case of a permanent new home. [SEP] he said that there appeared to be a chance that this year ' s budget might recover in time for the presidential election in january. [SEP] it ' s not something we have got to do in a big way. [SEP] " i don ' t have to have fun, " he said, " but it would be a situation i can remember, and i would be the only one who may not want to know... [SEP] he took his first order out of his business. [SEP] dallas, texas ( ap ) - [SEP] + +===== sample 038 ===== +[CLS] 1 million, or 5. 3 percent, to $ 2. 377 a share, while second - quarter revenue, which declined by $ 3. 2 billion, or 3. 4 percent, declined. [SEP] " ultimately i wanted to know what it was like to be a footballer - - i felt i thought he would work for me in my life, " said mr hill. [SEP] there have been three other changes to be in the squad. [SEP] the yemen - based al jazeera al - fitr al - e - aq al - islami group said more than 150 people have died so far in the country ' [SEP] + +===== sample 039 ===== +[CLS] nothing to stop the crime. [SEP] in reality, there has to be an attempt to sell the club to a manager who has little to offer, but he has nothing to talk about and that he would have to fight for a new job. [SEP] but in the case of the pope and the pope, there is a different view of the world, " he said. [SEP] some 2, 000 businesses were bailed out at the end of 2007, compared to more than 3 million. [SEP] the team ' s 6 - 3 road loss was only the knicks ' sixth road win. [SEP] young, of north carolina high school, said he [SEP] + +===== sample 040 ===== +[CLS] and the rest of obama ' s visit, either in washington, or over the weekend. [SEP] but i have paid the cost to a hospital, bank and insurance agency. [SEP] but that is to be the outcome of this super - big question. [SEP] " life will not be easy, unless you allow your children to run from school. [SEP] but he said that a full trial for those two would be a significant boost to the children ' s case. [SEP] it ' s a way of being done, and i ' m happy, " he said. [SEP] " this is a very good case for making sure whether we should be allowed [SEP] + +===== sample 041 ===== +[CLS] to cars, hotels, food, and even handouts, " he says. [SEP] i ' ll go on a sort of sled ( i like the show ) and feel guilty. [SEP] it was the sort of situation we ' re getting ourselves in - - we just put a couple of hoops and games in our heads. [SEP] we ' d never had a bit of what happened, " he said. [SEP] " there are no guarantees that there will be as much change... as we expected - - but i have an idea of it happening. [SEP] the number will probably grow to about 100, 000 in the next [SEP] + +===== sample 042 ===== +[CLS] the news is over again, leaving him without a foot on the car. [SEP] and the answer never got to the end. [SEP] i was aware that my mind changed on the day when i arrived, that the woman had given access to me and all of the people. [SEP] that ' s interesting. [SEP] if i wait for 15 minutes before a concert, i will see him again ( i ' m sure i ' ll listen ). [SEP] it ' s a short - term problem, and it ' s never going to make it to a big game, " he said. [SEP] " we believe some of the things we found to [SEP] + +===== sample 043 ===== +[CLS] [SEP] " i love the public option, but it ' s never been in the hospital, the brain, or the classroom, " she said. [SEP] we would, well, turn the focus for years on the president. [SEP] of course, they will be allowed to claim " they take a year ' s leave " for charity, or " try to make money " for trying to buy a property on a scale which they think is " fair tax. " [SEP] marshall ' s attorney, stephen heine, said there is a lot of work to do on toe - to - toe litigation - - no one knows where the matter is [SEP] + +===== sample 044 ===== +[CLS] 2010. [SEP] " it is very sad, really, because sometimes you feel like you don ' t be careful and that ' s what it takes to be successful, " she added. [SEP] four other vessels, including hundreds of crew members, were also also aboard. [SEP] in fact, they came with a host of different colors, from green dustwhies to rashes and the white redness of the brain ' s tissues. [SEP] i don ' t want to win, but i ' m on the other end. [SEP] i still want to finish school, even though i don ' t plan to leave. [SEP] the national [SEP] + +===== sample 045 ===== +[CLS] ' s funny, but it ' s ridiculous, " clinton told reporters on a flight from chicago to new york. [SEP] we always get the loose ball, so the result is very good. [SEP] " i want to try to score more. [SEP] it didn ' t happen until the start of the season. [SEP] we ' re going to see that happen again. [SEP] in the past year, there have been reports of attacks, which rose to more than 1, 100 in 2008. [SEP] " it ' s a day to talk to the world, " he said. [SEP] the male driver of the car - - robert james, 32 [SEP] + +===== sample 046 ===== +[CLS] willingness to step in to the public sphere. [SEP] you ' re just right, there ' s a lot to work out for you. [SEP] it is unlikely the next deal is due to be signed soon, because the costs are so high. [SEP] i know the first time i ' m not sure i ' m not going to make this happen to me, but at least i ' ve thought of myself. [SEP] as good as it sounds, he wants to go to high school, but that is still to go, a long way to go on a full - term career in virginia. [SEP] even though he ' s done much of [SEP] + +===== sample 047 ===== +[CLS] they can make journeys between home and overseas. [SEP] meanwhile, cleveland ' s james brown and the celtics ' kevin garnett offered a sort of push for the nba title. [SEP] i am sure it looks like people will be dead at the end of their lives, " she said. [SEP] 9 ( upi ) - - a study by u. s. health department officials found health systems in three states have a relatively high level of swine flu. [SEP] atlanta pushed the lead to 28 - 30 at the half - - including three of their nine 3 - pointers, including 4 - 1 1 / 2 minutes into the fourth [SEP] + +===== sample 048 ===== +[CLS] work relations and family relations. [SEP] the problem is very real. [SEP] the fate of the plant ' s owner, a nuclear official, is not to be known, but will be a critical component when the company reports at the start of the new year. [SEP] it also emerged that the victim did not know the government was ever involved in the case. [SEP] however, there is little time to go to work and create a new team. [SEP] i ' m sorry, but i do think it ' s important to read the whole story. [SEP] when i woke up, there was a restlessness of numbness, which was my reaction [SEP] + +===== sample 049 ===== +[CLS] confident that the president ' s power would be used to protect the president ' s health, " he wrote in remarks to reuters. [SEP] but the prime minister said she wanted to be reunited in the hands of a different administration. [SEP] i was there a few minutes later, looking very nice and he was having a lot of staches this time... [SEP] and so, i was much more concerned with the idea of a permanent solution to the problem of nuclear proliferation. [SEP] a spokesman said : " " i think we need to account for the payouts but we do not think we will get a deal when we go. [SEP] + +===== sample 050 ===== +[CLS] she added. [SEP] if this really was a problem... we don ' t need one to make a reference to the " nature of iran ' s nuclear program " ( and israel ) that has nothing to do with u. s. policy, but we cannot wait for the west to do that now.... [SEP] " we would come in, give them a good chance and make it a win, so if we were going to make a change, then we would take it later, " he says. [SEP] a good place to make money? [SEP] the second step would be to replace the 47 - year - old [SEP] + +===== sample 051 ===== +[CLS] a lender has to take a credit - card account. [SEP] but the organisation ' s appeal comes only two weeks after thousands of people killed or injured in violence. [SEP] " the president will get out of the way again, he can find what he knows a bit, what to get in there, " he said. [SEP] and that is not a great result. [SEP] if you are playing for the australian team you will probably have to wait for the opportunity. [SEP] but that has not happened in mexico, and the authorities expect them to be able to contact the rest of the population. [SEP] it is not unusual for me to think [SEP] + +===== sample 052 ===== +[CLS] points. [SEP] he has refused to disclose the details of the scope of his investigation, but insisted that he did not know the nature of the risk he would be released in prison for life. [SEP] a spokesman for the school system could not immediately be reached. [SEP] going to haiti was, well, not - for - a - goal. [SEP] in her life, he said, the girls seemed to have sex when they had no choice. [SEP] i don ' t let the doctor tell your friend, friend or brother, the money you make when you feel stupid is to make the money. [SEP] there ' s some things to look into [SEP] + +===== sample 053 ===== +[CLS]. [SEP] the two had offices, conference facilities and apartment buildings, and that could not be confirmed. [SEP] a surprise decision to replace india ' s toyota as the world ' s largest automaker has lost millions of jobs. [SEP] he ' s a democrat, he ' s built into a business. [SEP] no working group has been able to raise this amount, but at least he ' s been able to do it. [SEP] the official said the executive committee at the end of the summit has been working with the u. s., russia and china to make a case against the move. [SEP] the meeting took place as early as a [SEP] + +===== sample 054 ===== +[CLS] something we didn ' t want, " he said. [SEP] officials said the driver left shortly after the crash and was allowed to leave for the morning shift. [SEP] the best way for them is make sure they do not keep it safe. [SEP] so it ' s not a bad start. [SEP] " that could give me problems, " he said. [SEP] at the end of the year, that number will be about 13. [SEP] we have to use the opportunity to try to change the past and find the way to the future. [SEP] i, however, have a little connection with mr. nader....... [SEP] + +===== sample 055 ===== +[CLS] " i was going to see one of them, not going to see that one " at a time, he said. [SEP] " if there ' s something that is going to be done, and we ' ve all agreed that we ' ll be able to take it, i think there ' s something we can do, " scurry said. [SEP] i guess we are trying to change that. [SEP] ryan smyth ' s goal tied the scoreless at 2 - 2 with 3 : 05 left in the first. [SEP] more than 1, 200 people were injured in the crash, which killed 13 people between 2004 and 2006. [SEP] [SEP] + +===== sample 056 ===== +[CLS] don ' t think it is going to be like having make - up cheques in your car. [SEP] but if he ' s right, he ' s a coward. [SEP] and, well, well, we ' re going to know he ' s dead... and we don ' t have too much for him in jail. [SEP] " i don ' t like to be the wrong person, but i think it ' s her job to be honest, " she said before t. o. c. asked if her life had changed. [SEP] this is expected to total approximately $ 50 million in 2008 - 2010. [SEP] it [SEP] + +===== sample 057 ===== +[CLS] and we regain their independence. [SEP] john leahy, head of securities brokers, said the company ' s results have helped investors to focus on their options given the current economic environment. [SEP] " i usually have a job with a large group, where i have to do a job, sometimes for at least a year to a year, " he said. [SEP] " it would be a political stunt. [SEP] the heat won two games in the series, which ended after the season started going 2 - for - 5. [SEP] the pirates took off with a two - 0 run. [SEP] i cannot also look at other activities here. [SEP] [SEP] + +===== sample 058 ===== +[CLS] may have to pay other costs for their homes. [SEP] the family said they were trying to get a lawyer. [SEP] he was expected to return from his holiday when he returned to britain at the end of april. [SEP] associated press writer suna deby in nairobi, kenya contributed to this report. [SEP] when we focus on each other, we have a different response in which we respond to all of our problems. [SEP] after all, we have no jobs. [SEP] he retired at the end of the season in his second year in less than a year with the new york jets but he hasn ' t been with the packers. [SEP] he [SEP] + +===== sample 059 ===== +[CLS], we now have a focus on what we have to do. [SEP] that said, if you want to convene his position at this point he ' ll make a decision at this point to take stock in the company. [SEP] however, both companies have been forced to change the law to try to protect themselves against the recession. [SEP] she ' s only 18 years old, and she ' s over four years. [SEP] it is still running out of money and just doesn ' t seem to know much. [SEP] " i ' m confident the next president will resolve the problem, " he said. [SEP] that ' s what we need [SEP] + +===== sample 060 ===== +[CLS] co. [SEP] the border wall, which stands out on a concrete strip on the other side of the border, is now closed. [SEP] that ' s pretty much in itself. [SEP] it was a lot of fun. [SEP] it would have been easier to write off. [SEP] overtime _ 2, detroit, min, min ( hooking ), 17 : 08 roy, min ( hooking ), 18 : 08. [SEP] associated press writer anne gearan in washington contributed to this report. [SEP] " the rest of the tour is all i can and it forces me to get back and get the race there, " she said. [SEP] [SEP] + +===== sample 061 ===== +[CLS] the game - clincher at 2 - 3, scored on a power play just 22 minutes in the second period. [SEP] they may have turned his face on the subject, put in an interview and, with a smile, focused for days on the image of himself in the face. [SEP] " we are used to the leadership of the army. [SEP] i only was able to walk when i was in the middle of the night and thought i could have been standing in the tunnel. [SEP] donaghy said the league ' s decision does not comment on its decision. [SEP] his father reportedly died in december. [SEP] after india ' s elections [SEP] + +===== sample 062 ===== +[CLS] home to a home with her 7 - year - old son. [SEP] the letters were only " written in the united states, " according to national intelligence officials. [SEP] for that part of the day, president obama, who felt he had to make another big shift in the campaign, was a little far from in the right position for the region. [SEP] " he needs to be a better for the team, " said a source. [SEP] last year he issued 2, 035 orders in january. [SEP] the shows will air on the discovery channel and other shows next year. [SEP] it may seem to me at the top of this table [SEP] + +===== sample 063 ===== +[CLS] iraq, according to a recent report in the post. [SEP] mr. sandro is left by the end of the story, leaving him in the car, going off for hours - if not minutes - - in his hands. [SEP] " we are looking for a long - term extension of this strategy. [SEP] " our differences are great and i do not want to be alone. [SEP] " i know, the first time he started it, i would tell him to take him, it was always hard to pick a player after him, so i don ' t know if he could make up his mind. [SEP] " i don ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/state_c256_t1p45_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/state_c256_t1p45_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..eb4ef179cbab687264ac3d3281275ad3353a9185 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/state_c256_t1p45_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "state_c256_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c256_t1p45", "steps": 256, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 29.81545187350111, "nll_per_token": 3.3950267783717107, "tokens": 9500}, "diversity": {"sample_entropy": 4.085741040367163, "unique_tokens": 1473, "token_count": 8192, "distinct_1": 0.1798095703125, "distinct_2": 0.5905511811023622, "top_token_mass": 0.0538330078125}} +{"type": "sample", "index": 0, "raw_text": "[CLS] press reported. [SEP] i would have to cancel a couple of flights, but i was free to go... [SEP] the project, costing £1, 500, will make it possible to bring some of the world ' s best teams to the uk. [SEP] we ' re going to have an investigation that, with all our evidence, we have never seen before, \" he added. [SEP] the carmaker ford lost $ 60m in the first quarter alone. [SEP] \" there is a real need for transparency. [SEP] the scale of the devastation has been driven by the displacement and reshaping of nearly 10, 000 people around the world [SEP]", "detok_text": "[CLS] press reported. [SEP] i would have to cancel a couple of flights, but i was free to go... [SEP] the project, costing £1, 500, will make it possible to bring some of the world's best teams to the uk. [SEP] we're going to have an investigation that, with all our evidence, we have never seen before, \"he added. [SEP] the carmaker ford lost $60m in the first quarter alone. [SEP]\" there is a real need for transparency. [SEP] the scale of the devastation has been driven by the displacement and reshaping of nearly 10, 000 people around the world [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] - trade plan. [SEP] in the past, we have looked back at some ways, and i think the problem is, we did not get this far. [SEP] \" i think, ' john, i think he ' s ok, but i ' m not really in a position to talk to you. [SEP] \" it was a little bit of a big fight and we had to be aware of it, \" said the german. [SEP] for a moment, the place, if you kind of look out, seems to sit in perspective. [SEP] when a discussion of the president ' s fate actually takes place, so many of those who know [SEP]", "detok_text": "[CLS] - trade plan. [SEP] in the past, we have looked back at some ways, and i think the problem is, we did not get this far. [SEP] \"i think, ' john, i think he's ok, but i'm not really in a position to talk to you. [SEP]\" it was a little bit of a big fight and we had to be aware of it, \" said the german. [SEP] for a moment, the place, if you kind of look out, seems to sit in perspective. [SEP] when a discussion of the president's fate actually takes place, so many of those who know [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] the white house, \" he says. [SEP] i ' ve never known there has been a huge factor in the game. [SEP] he likes to get up, but a little bit well, and just works well in the gym. [SEP] \" i think we have to get a good deal, so if the result is a win, the majority is in danger of losing, \" ender said. [SEP] \" the idea is to get the money they want to get, and we ' re not able to make money, \" added schbutter. [SEP] the police have said that they were investigating more than a dozen complaints. [SEP] but [SEP]", "detok_text": "[CLS] the white house, \"he says. [SEP] i've never known there has been a huge factor in the game. [SEP] he likes to get up, but a little bit well, and just works well in the gym. [SEP]\" i think we have to get a good deal, so if the result is a win, the majority is in danger of losing, \"ender said. [SEP]\" the idea is to get the money they want to get, and we're not able to make money, \" added schbutter. [SEP] the police have said that they were investigating more than a dozen complaints. [SEP] but [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS] quite the way we are. [SEP] i just hope that i can do it again. [SEP] he says that he doesn ' t think he should talk to anyone trying to sell himself. [SEP] you know we ' ll take our lessons, \" said the foreign official. [SEP] i ' ve liked one one, i like the other, and of course he has to deal with this if he is a candidate when he gets into it. [SEP] \" there are also things you want to do with that work, such as getting dressed in white clouds, or capels, or even a black scarf, \" he added. [SEP] a government agency investigating [SEP]", "detok_text": "[CLS] quite the way we are. [SEP] i just hope that i can do it again. [SEP] he says that he doesn't think he should talk to anyone trying to sell himself. [SEP] you know we'll take our lessons, \"said the foreign official. [SEP] i've liked one one, i like the other, and of course he has to deal with this if he is a candidate when he gets into it. [SEP]\" there are also things you want to do with that work, such as getting dressed in white clouds, or capels, or even a black scarf, \" he added. [SEP] a government agency investigating [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] : \" the total of stolen items includes a number of personal items including household goods, airbags and computers. [SEP] \" i don ' t think it was until my 70s that i really got into trouble, \" he said, \" i can ' t make it much better - - i didn ' t even have a talking point. [SEP] officials from around the world and more than a 100 other countries attended the event. [SEP] while he is so popular in the united states, he is critical of his free - trade policies in the u. s. and calling for the collapse of the union. [SEP] the production also features a three - [SEP]", "detok_text": "[CLS]: \"the total of stolen items includes a number of personal items including household goods, airbags and computers. [SEP]\" i don't think it was until my 70s that i really got into trouble, \"he said,\" i can't make it much better - - i didn't even have a talking point. [SEP] officials from around the world and more than a 100 other countries attended the event. [SEP] while he is so popular in the united states, he is critical of his free - trade policies in the u. s. and calling for the collapse of the union. [SEP] the production also features a three - [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] guide them to the democratic nomination. [SEP] \" i ' ve got quite a concern about the number of people who have worked and the number of people who have been working and thought about the quality of things that are done or if they have been worked out. [SEP] \" we don ' t want to know that he can play in the future, \" said peter westbrook, the club ' s assistant coach. [SEP] it was last updated at 20. 54 bst on thursday 16 may 2009. office for the city of london. greater london, south london. £36, 624 to £43, 000 per annum. [SEP] he [SEP]", "detok_text": "[CLS] guide them to the democratic nomination. [SEP] \"i've got quite a concern about the number of people who have worked and the number of people who have been working and thought about the quality of things that are done or if they have been worked out. [SEP]\" we don't want to know that he can play in the future, \" said peter westbrook, the club's assistant coach. [SEP] it was last updated at 20. 54 bst on thursday 16 may 2009. office for the city of london. greater london, south london. £36, 624 to £43, 000 per annum. [SEP] he [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] air crash in rome, witnesses said. [SEP] \" i ' ll do that and i ' m glad this has been resolved. [SEP] since the 10th century, the u. s. government has never been part of iraq. [SEP] it said that after several days the children, who would be temporary workers who did not see their parents for another six weeks, would not receive full visas and would be free from their work. [SEP] i just wanted to let him stand up and try to get here, \" according to the eca. [SEP] the nets also scored 13 of his 15 points in 20 minutes - - he had 16 rebounds in the [SEP]", "detok_text": "[CLS] air crash in rome, witnesses said. [SEP] \"i'll do that and i'm glad this has been resolved. [SEP] since the 10th century, the u. s. government has never been part of iraq. [SEP] it said that after several days the children, who would be temporary workers who did not see their parents for another six weeks, would not receive full visas and would be free from their work. [SEP] i just wanted to let him stand up and try to get here,\" according to the eca. [SEP] the nets also scored 13 of his 15 points in 20 minutes - - he had 16 rebounds in the [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] in a series of federal deficits and budget shortcomings. [SEP] i mean, if you ask me to look at you, you ' re a celebrity, it ' s just hard to imagine. [SEP] a 19. 1 share in california ' s unemployment report, down slightly in chicago in august. [SEP] in the end, the swiss group had to set a compensation deal with the government and was promised the full compensation of the bank ' s 5, 000 employees. [SEP] so it ' s not been easy for him, as we both know the rules. [SEP] the first game of the series was 14 - point loss to detroit. [SEP]", "detok_text": "[CLS] in a series of federal deficits and budget shortcomings. [SEP] i mean, if you ask me to look at you, you're a celebrity, it's just hard to imagine. [SEP] a 19. 1 share in california's unemployment report, down slightly in chicago in august. [SEP] in the end, the swiss group had to set a compensation deal with the government and was promised the full compensation of the bank's 5, 000 employees. [SEP] so it's not been easy for him, as we both know the rules. [SEP] the first game of the series was 14 - point loss to detroit. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] 57. 7 million. [SEP] i believe that they will not be able to pay the cost. [SEP] \" if we ' ve got a team where we are up to the task, we want to do it in terms of our commitment to football, \" barca said. [SEP] what has been the challenge for children to learn from the past? [SEP] mr brown said the leaders had all agreed on a get - in for the couple. [SEP] on wednesday, the protesters sent riot police, police trucks, fire engines and soldiers on their way to the stadium for a second time. [SEP] the group is led by john bord. [SEP] but [SEP]", "detok_text": "[CLS] 57. 7 million. [SEP] i believe that they will not be able to pay the cost. [SEP] \"if we've got a team where we are up to the task, we want to do it in terms of our commitment to football,\" barca said. [SEP] what has been the challenge for children to learn from the past? [SEP] mr brown said the leaders had all agreed on a get - in for the couple. [SEP] on wednesday, the protesters sent riot police, police trucks, fire engines and soldiers on their way to the stadium for a second time. [SEP] the group is led by john bord. [SEP] but [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] their vehicles. [SEP] still, it took them four years to achieve the first cut in the government ' s funding in three years and start to the school year. [SEP] we ' ve told them. [SEP] the victims collected up to $ 20, 000 in cash, cash, cash, cash, cigarettes and cash, police said. [SEP] \" when we get down to the final i think it ' s something that we have been trying to do for a long time for us. [SEP] \" it ' s just a small number to look for, it ' s not true, \" she said, \" \" well, i don ' t need [SEP]", "detok_text": "[CLS] their vehicles. [SEP] still, it took them four years to achieve the first cut in the government's funding in three years and start to the school year. [SEP] we've told them. [SEP] the victims collected up to $20, 000 in cash, cash, cash, cash, cigarettes and cash, police said. [SEP] \"when we get down to the final i think it's something that we have been trying to do for a long time for us. [SEP]\" it's just a small number to look for, it's not true, \"she said,\" \" well, i don't need [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] - - \" he joked. [SEP] \" this announcement is a response to the lack of public funding, \" said a spokesman of the children of education committee. [SEP] however, as a result, i think i ' m in the right mood. [SEP] clinton has said the us will help to improve the political situation in zimbabwe. [SEP] we ' ll see. [SEP] and it is a great thing to help them in the day and help them in a good way. [SEP] on the other hand, one thing is to overcome this fear and prejudice. [SEP] another £1 million a year has also gone into the children ' s education fund, which has [SEP]", "detok_text": "[CLS] - - \"he joked. [SEP]\" this announcement is a response to the lack of public funding, \" said a spokesman of the children of education committee. [SEP] however, as a result, i think i'm in the right mood. [SEP] clinton has said the us will help to improve the political situation in zimbabwe. [SEP] we'll see. [SEP] and it is a great thing to help them in the day and help them in a good way. [SEP] on the other hand, one thing is to overcome this fear and prejudice. [SEP] another £1 million a year has also gone into the children's education fund, which has [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] in front of others. [SEP] it just seems to pick up the air of the wind. [SEP] boca raton, fla., march 3 ( upi ) - - owners of u. s. retailers said they expect to be down by as much as 10 percent in the second half of 2008, a survey said. [SEP] he lives in chicago. [SEP] he said there was no sign the club was going to replace him, so there was none of them to replace him. [SEP] the court heard the ex - president was staying at home, four years after losing the presidency in 2001. [SEP] on friday, senate republican leader john [SEP]", "detok_text": "[CLS] in front of others. [SEP] it just seems to pick up the air of the wind. [SEP] boca raton, fla., march 3 (upi) - - owners of u. s. retailers said they expect to be down by as much as 10 percent in the second half of 2008, a survey said. [SEP] he lives in chicago. [SEP] he said there was no sign the club was going to replace him, so there was none of them to replace him. [SEP] the court heard the ex - president was staying at home, four years after losing the presidency in 2001. [SEP] on friday, senate republican leader john [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS] weekend, said he was \" tired \" and had \" nothing to do \" with a run that was \" normal \" after he started. [SEP] i had the message being, \" don ' t talk about you anymore. \" [SEP] i have sex every day, every 20 - year - old girl loves it. [SEP] you ' re always looking to pick up a job of your own or make some money, but there ' s a lot of work to get in. [SEP] where are your best friends? [SEP] i ' m sure that he ' s the guy who can have the things we want, have the things that i can trust, [SEP]", "detok_text": "[CLS] weekend, said he was \"tired\" and had \"nothing to do\" with a run that was \"normal\" after he started. [SEP] i had the message being, \"don't talk about you anymore.\" [SEP] i have sex every day, every 20 - year - old girl loves it. [SEP] you're always looking to pick up a job of your own or make some money, but there's a lot of work to get in. [SEP] where are your best friends? [SEP] i'm sure that he's the guy who can have the things we want, have the things that i can trust, [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS]. s. kabul, afghanistan ( ap ) - - a roadside bomb ripped through an eastern afghan town wednesday, killing a dozen people and wounding 24 others, including three children, and a schoolgirl, provincial police and officials said. [SEP] until then, at least it hadn ' t come to saturday ' s conclusion. [SEP] \" no one will be responsible for the breach of security, \" he added. [SEP] the safety condition of the two - lane scat would be set in proportion to a narrow exit where the driver of a car on the other side would hit the driver ' s hand, causing the driver to be stuck. [SEP] [SEP]", "detok_text": "[CLS]. s. kabul, afghanistan (ap) - - a roadside bomb ripped through an eastern afghan town wednesday, killing a dozen people and wounding 24 others, including three children, and a schoolgirl, provincial police and officials said. [SEP] until then, at least it hadn't come to saturday's conclusion. [SEP] \"no one will be responsible for the breach of security,\" he added. [SEP] the safety condition of the two - lane scat would be set in proportion to a narrow exit where the driver of a car on the other side would hit the driver's hand, causing the driver to be stuck. [SEP] [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] \" said mohammed. [SEP] he is so fast - - and yet he sees, at first, the freshness of the light and the warmth of the all - around sun that brought him down from the moon to earth. [SEP] we still don ' t know. [SEP] \" you don ' t always know what you ' re going for. [SEP] \" it ' s hard to see, it ' s hard to take out anything that ' s important at all, \" she says. [SEP] \" we did have more problems, \" said coach scott brown, a member of the nfl players ' association. [SEP] \" the president and manager, all [SEP]", "detok_text": "[CLS] \"said mohammed. [SEP] he is so fast - - and yet he sees, at first, the freshness of the light and the warmth of the all - around sun that brought him down from the moon to earth. [SEP] we still don't know. [SEP]\" you don't always know what you're going for. [SEP] \"it's hard to see, it's hard to take out anything that's important at all,\" she says. [SEP] \"we did have more problems,\" said coach scott brown, a member of the nfl players' association. [SEP] \" the president and manager, all [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS] of the children. [SEP] they won ' t be able to see you, but we better know them if they don ' t put their money on a table. [SEP] i don ' t know. [SEP] that used to be fine on the street, but with the doors closed and the busses running from front to back streets, it didn ' t go that far. [SEP] in the early 2000s, however, rates were sharply lower. [SEP] \" there ' s a lot of work going on, and it was not wrong, \" he said. [SEP] \" i ' ve just got a little bit of a fight. [SEP] since then, [SEP]", "detok_text": "[CLS] of the children. [SEP] they won't be able to see you, but we better know them if they don't put their money on a table. [SEP] i don't know. [SEP] that used to be fine on the street, but with the doors closed and the busses running from front to back streets, it didn't go that far. [SEP] in the early 2000s, however, rates were sharply lower. [SEP] \"there's a lot of work going on, and it was not wrong,\" he said. [SEP] \" i've just got a little bit of a fight. [SEP] since then, [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] said. [SEP] similar turbines are being built in the uk, but needs to be completed by 2013, said a senior government official involved in the talks. [SEP] he made 25 of 32 shots from the field before punting on 3 - of - 13 three - goal attempts saturday night in the wild 1 - 0 loss to san jose city, the first victory of the season a day earlier. [SEP] there ' s a problem that can seem to cause any amount of mental pain, \" said kitz. [SEP] we must change our perception, and without any change, we must still make a lot of mistakes, and act fast, and we [SEP]", "detok_text": "[CLS] said. [SEP] similar turbines are being built in the uk, but needs to be completed by 2013, said a senior government official involved in the talks. [SEP] he made 25 of 32 shots from the field before punting on 3 - of - 13 three - goal attempts saturday night in the wild 1 - 0 loss to san jose city, the first victory of the season a day earlier. [SEP] there's a problem that can seem to cause any amount of mental pain, \" said kitz. [SEP] we must change our perception, and without any change, we must still make a lot of mistakes, and act fast, and we [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] to obama ' s visit to america in june, that he seemed to understand that he really was going to behave in different conditions. [SEP] there is such a sense of optimism and change for you, according to cbs / kland. com. [SEP] it would be in good faith. [SEP] \" that ' s not necessarily what we ' re about. [SEP] that ' s a good thing, it ' s kind of a joke. [SEP] wake up and drop the story for comment. [SEP] \" we believe that we still have the ability to win, \" said mr brown. [SEP] new york - kirilenko scored 26 points and jason terry [SEP]", "detok_text": "[CLS] to obama's visit to america in june, that he seemed to understand that he really was going to behave in different conditions. [SEP] there is such a sense of optimism and change for you, according to cbs/kland. com. [SEP] it would be in good faith. [SEP] \"that's not necessarily what we're about. [SEP] that's a good thing, it's kind of a joke. [SEP] wake up and drop the story for comment. [SEP]\" we believe that we still have the ability to win, \" said mr brown. [SEP] new york - kirilenko scored 26 points and jason terry [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS] in the first quarter of december 2007. [SEP] the u. s. c. arrived at the air station at about 8 a. m. and returned immediately, according to one person with knowledge of the condition of monday ' s departures. [SEP] the president has gotten the message quickly and cautioned citizens to be on alert. [SEP] capello ' s team could play against the united states in this week ' s group stage, and italy has three games in the final, but it ' s not. [SEP] then, however, we moved into the middle of a relationship. [SEP] lake city, ill. - - the man who killed [SEP]", "detok_text": "[CLS] in the first quarter of december 2007. [SEP] the u. s. c. arrived at the air station at about 8 a. m. and returned immediately, according to one person with knowledge of the condition of monday's departures. [SEP] the president has gotten the message quickly and cautioned citizens to be on alert. [SEP] capello's team could play against the united states in this week's group stage, and italy has three games in the final, but it's not. [SEP] then, however, we moved into the middle of a relationship. [SEP] lake city, ill. - - the man who killed [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] confirmed his move to rangers on tuesday and are due to start their european campaign in the light of the first game of chelsea ' s trip to ibrox. [SEP] the trial was scheduled to take place in 2009. [SEP] we ' re not doing enough - - we will get that fast if we can go. [SEP] for example, the concept of a low - end car could go on the road. [SEP] \" i ' m concerned that we will have a new set of rules that we have to sort out, and there will be more changes in financial financial systems over the couple of years, \" he said. [SEP] the capital, [SEP]", "detok_text": "[CLS] confirmed his move to rangers on tuesday and are due to start their european campaign in the light of the first game of chelsea's trip to ibrox. [SEP] the trial was scheduled to take place in 2009. [SEP] we're not doing enough - - we will get that fast if we can go. [SEP] for example, the concept of a low - end car could go on the road. [SEP] \"i'm concerned that we will have a new set of rules that we have to sort out, and there will be more changes in financial financial systems over the couple of years,\" he said. [SEP] the capital, [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] person familiar with the matter. [SEP] new york ' s health insurance program is designed to inflate financial costs. [SEP] it took only a few minutes to develop. [SEP] at that time, in february 2008, the percentage of people paying a 10 - year mortgage rose this year from 13 % to 3. 8 %. [SEP] they let us do nothing in the past. [SEP] \" we don ' t talk about a financial crisis, it ' s just getting people together, \" he added. [SEP] but the goal is to make up for the fire that is coming in markets that are getting stressed, including mortgage - backed securities, which [SEP]", "detok_text": "[CLS] person familiar with the matter. [SEP] new york's health insurance program is designed to inflate financial costs. [SEP] it took only a few minutes to develop. [SEP] at that time, in february 2008, the percentage of people paying a 10 - year mortgage rose this year from 13 % to 3. 8 %. [SEP] they let us do nothing in the past. [SEP] \"we don't talk about a financial crisis, it's just getting people together,\" he added. [SEP] but the goal is to make up for the fire that is coming in markets that are getting stressed, including mortgage - backed securities, which [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] still lives, and he knows how to make a living. [SEP] the council has provided £5, 000 to cover the building and £5, 000 to design, with the rest still to be added. [SEP] it is really hard for him to see anything in a way. [SEP] the mets are trying to add santana, for example, who is looking for a good season. [SEP] then she dropped off her clothes. [SEP] he is still trying to keep a lead while even keeping the ball in playoff games. [SEP] the union said it represents more than 2, 000 temporary workers, and that drivers would have to work overtime. [SEP] instead, the [SEP]", "detok_text": "[CLS] still lives, and he knows how to make a living. [SEP] the council has provided £5, 000 to cover the building and £5, 000 to design, with the rest still to be added. [SEP] it is really hard for him to see anything in a way. [SEP] the mets are trying to add santana, for example, who is looking for a good season. [SEP] then she dropped off her clothes. [SEP] he is still trying to keep a lead while even keeping the ball in playoff games. [SEP] the union said it represents more than 2, 000 temporary workers, and that drivers would have to work overtime. [SEP] instead, the [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] 1. 5 - game run. [SEP] in 2004, chicago - based boston pitchers hit jason varitek three times. [SEP] he had been jailed in october 2007 for six months, and before he was last seen near his family home in parkville, n. j., he was drunk during his break - in. [SEP] last week darling announced that the public debt - - which includes roads, playgrounds, super - schools, universities, schools, hospitals, hospitals, high - rises and roads - - would be repaid by the end of the year. [SEP] the team is one of the best teams on the planet. [SEP] [SEP]", "detok_text": "[CLS] 1. 5 - game run. [SEP] in 2004, chicago - based boston pitchers hit jason varitek three times. [SEP] he had been jailed in october 2007 for six months, and before he was last seen near his family home in parkville, n. j., he was drunk during his break - in. [SEP] last week darling announced that the public debt - - which includes roads, playgrounds, super - schools, universities, schools, hospitals, hospitals, high - rises and roads - - would be repaid by the end of the year. [SEP] the team is one of the best teams on the planet. [SEP] [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS] million. [SEP] \" when i ' m not there, it ' s not about winning, it ' s winning. [SEP] at the time, the young man wore a jumper with his short - sleeve shirt, and a dark shirt, bottoms and bottoms. [SEP] father phillips, 67, said that he had already seen his wife, and that in a marriage he ' s had 50 years and 10 children. [SEP] there is no connection between reading and high school scores. [SEP] meanwhile, the u. s. foreign relations office is doing so in line with international court rules. [SEP] i don ' t need anything. [SEP] the electoral process has [SEP]", "detok_text": "[CLS] million. [SEP] \" when i'm not there, it's not about winning, it's winning. [SEP] at the time, the young man wore a jumper with his short - sleeve shirt, and a dark shirt, bottoms and bottoms. [SEP] father phillips, 67, said that he had already seen his wife, and that in a marriage he's had 50 years and 10 children. [SEP] there is no connection between reading and high school scores. [SEP] meanwhile, the u. s. foreign relations office is doing so in line with international court rules. [SEP] i don't need anything. [SEP] the electoral process has [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] part of the couple ' s life - - a three - way, four - year relationship. [SEP] when i ' ve had a break - - i would want to take one other out, but i ' m not alone - - i always get depressed. [SEP] switzerland, and swiss banks in particular, has a lot of the money flowing. [SEP] he also said that it was important to have the support of all people. [SEP] i have to believe that we should start talking to the world. [SEP] by the time we came round, the doors were open. [SEP] but nobody has thought of a full sit - down, or even a [SEP]", "detok_text": "[CLS] part of the couple's life - - a three - way, four - year relationship. [SEP] when i've had a break - - i would want to take one other out, but i'm not alone - - i always get depressed. [SEP] switzerland, and swiss banks in particular, has a lot of the money flowing. [SEP] he also said that it was important to have the support of all people. [SEP] i have to believe that we should start talking to the world. [SEP] by the time we came round, the doors were open. [SEP] but nobody has thought of a full sit - down, or even a [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] that they are to be well informed and that message is very strong, \" he said. [SEP] he said then, \" i know it is the day of the game and it was particularly important and would have been a good start. [SEP] and maybe he wasn ' t funny, but people think he was real. [SEP] by the start of the 2004 presidential campaign - - just a three months - - he was on the need to talk with americans about his patriotism. [SEP] but don ' t expect a panic. [SEP] he doesn ' t understand where you are, \" he said. [SEP] \" i find it hard to make the most [SEP]", "detok_text": "[CLS] that they are to be well informed and that message is very strong, \"he said. [SEP] he said then,\" i know it is the day of the game and it was particularly important and would have been a good start. [SEP] and maybe he wasn't funny, but people think he was real. [SEP] by the start of the 2004 presidential campaign - - just a three months - - he was on the need to talk with americans about his patriotism. [SEP] but don't expect a panic. [SEP] he doesn't understand where you are, \"he said. [SEP]\" i find it hard to make the most [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] smashed glass windows in his home. [SEP] \" it could be said that when we ' re not going to do something - - we don ' t know, we ' re going to do something - - we can have a better life. [SEP] \" i really wanted to do something, i love it because i thought twice about you, that kind of really about what i can do. [SEP] he says he paid $ 10, 000 and sold the tickets for $ 800, but he was able to get out of the room. [SEP] \" they are the people who would have been a small part of that, \" hairston said. [SEP] [SEP]", "detok_text": "[CLS] smashed glass windows in his home. [SEP] \"it could be said that when we're not going to do something - - we don't know, we're going to do something - - we can have a better life. [SEP]\" i really wanted to do something, i love it because i thought twice about you, that kind of really about what i can do. [SEP] he says he paid $10, 000 and sold the tickets for $800, but he was able to get out of the room. [SEP] \"they are the people who would have been a small part of that,\" hairston said. [SEP] [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS] crack down on the quality of their players. [SEP] smith, however, remains optimistic. [SEP] \" it ' s hard to call some of the facilities part of a return to old days, \" he said, as a man waited in the new president ' s office at the palace. [SEP] you can just take a flight from the office and then get a job, a salary or a couple of dollars to make a visit. [SEP] i knew i had to live in my own well - lit tent, an out - of - town place and a place to go in. [SEP] however, we ' ve got a lot of people having to [SEP]", "detok_text": "[CLS] crack down on the quality of their players. [SEP] smith, however, remains optimistic. [SEP] \"it's hard to call some of the facilities part of a return to old days,\" he said, as a man waited in the new president's office at the palace. [SEP] you can just take a flight from the office and then get a job, a salary or a couple of dollars to make a visit. [SEP] i knew i had to live in my own well - lit tent, an out - of - town place and a place to go in. [SEP] however, we've got a lot of people having to [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] m. c. a. tournament. [SEP] u. s. troops killed in iraq in 2007 dropped up to 38 at the start of this year, according to the pentagon ' s statement. [SEP] i am a college student because i have lived all my life. [SEP] now, that ' s a small group. [SEP] hours after the team ' s president announced his decision on thursday night, the knicks protested and asked thomas to not sign his contract and had no comment. [SEP] but if that ' s enough to stop that change, it has yet to be approved. [SEP] \" it ' s fair to say there is a huge part of [SEP]", "detok_text": "[CLS] m. c. a. tournament. [SEP] u. s. troops killed in iraq in 2007 dropped up to 38 at the start of this year, according to the pentagon's statement. [SEP] i am a college student because i have lived all my life. [SEP] now, that's a small group. [SEP] hours after the team's president announced his decision on thursday night, the knicks protested and asked thomas to not sign his contract and had no comment. [SEP] but if that's enough to stop that change, it has yet to be approved. [SEP] \" it's fair to say there is a huge part of [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] return at home. [SEP] for example, the western state of england is thought to have the largest share of the population of 11 percent. [SEP] \" the allegations are untrued, \" he says. [SEP] in the ruling, mr justice weir said : \" mr mcnulty immediately went to the office of justice and provided his details to the tax office, the revenue commissioner, the irs, the treasury secretary, the attorney general and the u. s. department of justice to help to provide financial services in the uk. [SEP] we ' ve done it. [SEP] the two are also likely to focus on the need for political settlement [SEP]", "detok_text": "[CLS] return at home. [SEP] for example, the western state of england is thought to have the largest share of the population of 11 percent. [SEP] \"the allegations are untrued,\" he says. [SEP] in the ruling, mr justice weir said: \" mr mcnulty immediately went to the office of justice and provided his details to the tax office, the revenue commissioner, the irs, the treasury secretary, the attorney general and the u. s. department of justice to help to provide financial services in the uk. [SEP] we've done it. [SEP] the two are also likely to focus on the need for political settlement [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] his own close relationship with his old england manager. [SEP] \" the road can get to the end. [SEP] he has been known to move in the past few months. [SEP] \" immediately after the blast, we had a very difficult effort to get our eye out of the area. [SEP] \" we ' d be talking about how you can ' t go over there, which i don ' t know, that kind of thing, you know, that was, \" mr. jordan said. [SEP] it ' s hard to believe, people. [SEP] but it may not come until the end of the year. [SEP] but in truth, i had [SEP]", "detok_text": "[CLS] his own close relationship with his old england manager. [SEP] \"the road can get to the end. [SEP] he has been known to move in the past few months. [SEP]\" immediately after the blast, we had a very difficult effort to get our eye out of the area. [SEP] \"we'd be talking about how you can't go over there, which i don't know, that kind of thing, you know, that was,\" mr. jordan said. [SEP] it's hard to believe, people. [SEP] but it may not come until the end of the year. [SEP] but in truth, i had [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] sunday ' s event. [SEP] \", however, the misunderstandings on this issue have to be addressed, \" the officials said. [SEP] still, the loss of a loan, which is made for them by their lenders, is not enough of a reason to let go. [SEP] it is also expected that a number of measures will be made to turn around the world economy. [SEP] about a third of the country ' s 2 million children and their families are estimated to be poor, most of them due to poverty. [SEP] we have all been in it for too long, but we have to put up our best ideas. [SEP] the [SEP]", "detok_text": "[CLS] sunday's event. [SEP] \", however, the misunderstandings on this issue have to be addressed, \" the officials said. [SEP] still, the loss of a loan, which is made for them by their lenders, is not enough of a reason to let go. [SEP] it is also expected that a number of measures will be made to turn around the world economy. [SEP] about a third of the country's 2 million children and their families are estimated to be poor, most of them due to poverty. [SEP] we have all been in it for too long, but we have to put up our best ideas. [SEP] the [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] need to put this money on their tax bill by now, and that isn ' t quite much down at the end of 2011. [SEP] in a study from 2004 to 2008, the percentage of female child victims increased slightly to just 2. 3 percent. [SEP] i was born long before i was done. [SEP] they haven ' t done it. [SEP] he can ' t live to lose. [SEP] he ' s got a good game, and he does it well. [SEP] \" i would say it was a good start to make decisions for you, \" he said. [SEP] i don ' t really think that we didn ' t want to [SEP]", "detok_text": "[CLS] need to put this money on their tax bill by now, and that isn't quite much down at the end of 2011. [SEP] in a study from 2004 to 2008, the percentage of female child victims increased slightly to just 2. 3 percent. [SEP] i was born long before i was done. [SEP] they haven't done it. [SEP] he can't live to lose. [SEP] he's got a good game, and he does it well. [SEP] \"i would say it was a good start to make decisions for you,\" he said. [SEP] i don't really think that we didn't want to [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS] and italy. [SEP] finally, instead of watching, i had to go to the weather office to check up for the next morning. [SEP] \" the market to build a market is going to be built in a kind of way. [SEP] he told the newspaper in the days before the murder trial that he had no regrets and would not fight the charges. [SEP] \" i don ' t think you should be allowed to talk about it, but i ' m not very happy, \" he said. [SEP] on saturday, he was attacked with another woman in the force area. [SEP] but that does not happen. [SEP] \" there didn ' t be [SEP]", "detok_text": "[CLS] and italy. [SEP] finally, instead of watching, i had to go to the weather office to check up for the next morning. [SEP] \"the market to build a market is going to be built in a kind of way. [SEP] he told the newspaper in the days before the murder trial that he had no regrets and would not fight the charges. [SEP]\" i don't think you should be allowed to talk about it, but i'm not very happy, \"he said. [SEP] on saturday, he was attacked with another woman in the force area. [SEP] but that does not happen. [SEP]\" there didn't be [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS], 50 years in a row, to seven games. [SEP] the woman is about 5ft 6in tall ( 4. 8m, 11. 4m ). [SEP] he is there, exposing syonies, making repeated gestures at them, biting them, and raping them hideously. [SEP] even before he had a good season with the yankees, the team was dominant. [SEP] the house of commons, the upper chamber, has used the two - thirds majority to bring in 21 seats. [SEP] \" you have to come back to me and have a conversation with me and i want to win. [SEP] i don ' t think [SEP]", "detok_text": "[CLS], 50 years in a row, to seven games. [SEP] the woman is about 5ft 6in tall (4. 8m, 11. 4m). [SEP] he is there, exposing syonies, making repeated gestures at them, biting them, and raping them hideously. [SEP] even before he had a good season with the yankees, the team was dominant. [SEP] the house of commons, the upper chamber, has used the two - thirds majority to bring in 21 seats. [SEP] \" you have to come back to me and have a conversation with me and i want to win. [SEP] i don't think [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS] the first time sunday. [SEP] \" i knew that i wanted to be able to be there, \" rodriguez said in a statement. [SEP] \" if they didn ' t have that kind of money, then it wouldn ' t happen at all, \" mr horsin said. [SEP] \" the door is no longer open, \" she said. [SEP] ms. bork, 53, and her son, austin, have developed an interest in state - funded insurance companies. [SEP] but that strategy seemed to work well with him. [SEP] 27 / prnewswire / - - raytheon corporation ( nyse : dn ), [SEP]", "detok_text": "[CLS] the first time sunday. [SEP] \"i knew that i wanted to be able to be there,\" rodriguez said in a statement. [SEP] \"if they didn't have that kind of money, then it wouldn't happen at all,\" mr horsin said. [SEP] \"the door is no longer open,\" she said. [SEP] ms. bork, 53, and her son, austin, have developed an interest in state - funded insurance companies. [SEP] but that strategy seemed to work well with him. [SEP] 27/prnewswire/- - raytheon corporation (nyse: dn), [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] it seemed to take a while to get me started, so i wanted to start the game. [SEP] but it was set up by government and international organizations that also supported the project. [SEP] for many people, ailing has worked as a relief. [SEP] there ' s always an ideal world where you have to grow into your own. [SEP] \" she was so excited, \" kroe said. [SEP] but when i say about it, you tell me what i want, and then there will be a large cup of sweet tea. [SEP] \" i think he ' s going up and down, ' if we don ' t do that [SEP]", "detok_text": "[CLS] it seemed to take a while to get me started, so i wanted to start the game. [SEP] but it was set up by government and international organizations that also supported the project. [SEP] for many people, ailing has worked as a relief. [SEP] there's always an ideal world where you have to grow into your own. [SEP] \"she was so excited,\" kroe said. [SEP] but when i say about it, you tell me what i want, and then there will be a large cup of sweet tea. [SEP] \" i think he's going up and down, ' if we don't do that [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS], which is not easy from the field. [SEP] that is enough in the case of a permanent new home. [SEP] he said that there appeared to be a chance that this year ' s budget might recover in time for the presidential election in january. [SEP] it ' s not something we have got to do in a big way. [SEP] \" i don ' t have to have fun, \" he said, \" but it would be a situation i can remember, and i would be the only one who may not want to know... [SEP] he took his first order out of his business. [SEP] dallas, texas ( ap ) - [SEP]", "detok_text": "[CLS], which is not easy from the field. [SEP] that is enough in the case of a permanent new home. [SEP] he said that there appeared to be a chance that this year's budget might recover in time for the presidential election in january. [SEP] it's not something we have got to do in a big way. [SEP] \"i don't have to have fun,\" he said, \" but it would be a situation i can remember, and i would be the only one who may not want to know... [SEP] he took his first order out of his business. [SEP] dallas, texas (ap) - [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] 1 million, or 5. 3 percent, to $ 2. 377 a share, while second - quarter revenue, which declined by $ 3. 2 billion, or 3. 4 percent, declined. [SEP] \" ultimately i wanted to know what it was like to be a footballer - - i felt i thought he would work for me in my life, \" said mr hill. [SEP] there have been three other changes to be in the squad. [SEP] the yemen - based al jazeera al - fitr al - e - aq al - islami group said more than 150 people have died so far in the country ' [SEP]", "detok_text": "[CLS] 1 million, or 5. 3 percent, to $2. 377 a share, while second - quarter revenue, which declined by $3. 2 billion, or 3. 4 percent, declined. [SEP] \"ultimately i wanted to know what it was like to be a footballer - - i felt i thought he would work for me in my life,\" said mr hill. [SEP] there have been three other changes to be in the squad. [SEP] the yemen - based al jazeera al - fitr al - e - aq al - islami group said more than 150 people have died so far in the country ' [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] nothing to stop the crime. [SEP] in reality, there has to be an attempt to sell the club to a manager who has little to offer, but he has nothing to talk about and that he would have to fight for a new job. [SEP] but in the case of the pope and the pope, there is a different view of the world, \" he said. [SEP] some 2, 000 businesses were bailed out at the end of 2007, compared to more than 3 million. [SEP] the team ' s 6 - 3 road loss was only the knicks ' sixth road win. [SEP] young, of north carolina high school, said he [SEP]", "detok_text": "[CLS] nothing to stop the crime. [SEP] in reality, there has to be an attempt to sell the club to a manager who has little to offer, but he has nothing to talk about and that he would have to fight for a new job. [SEP] but in the case of the pope and the pope, there is a different view of the world, \" he said. [SEP] some 2, 000 businesses were bailed out at the end of 2007, compared to more than 3 million. [SEP] the team's 6 - 3 road loss was only the knicks' sixth road win. [SEP] young, of north carolina high school, said he [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] and the rest of obama ' s visit, either in washington, or over the weekend. [SEP] but i have paid the cost to a hospital, bank and insurance agency. [SEP] but that is to be the outcome of this super - big question. [SEP] \" life will not be easy, unless you allow your children to run from school. [SEP] but he said that a full trial for those two would be a significant boost to the children ' s case. [SEP] it ' s a way of being done, and i ' m happy, \" he said. [SEP] \" this is a very good case for making sure whether we should be allowed [SEP]", "detok_text": "[CLS] and the rest of obama's visit, either in washington, or over the weekend. [SEP] but i have paid the cost to a hospital, bank and insurance agency. [SEP] but that is to be the outcome of this super - big question. [SEP] \"life will not be easy, unless you allow your children to run from school. [SEP] but he said that a full trial for those two would be a significant boost to the children's case. [SEP] it's a way of being done, and i'm happy,\" he said. [SEP] \" this is a very good case for making sure whether we should be allowed [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] to cars, hotels, food, and even handouts, \" he says. [SEP] i ' ll go on a sort of sled ( i like the show ) and feel guilty. [SEP] it was the sort of situation we ' re getting ourselves in - - we just put a couple of hoops and games in our heads. [SEP] we ' d never had a bit of what happened, \" he said. [SEP] \" there are no guarantees that there will be as much change... as we expected - - but i have an idea of it happening. [SEP] the number will probably grow to about 100, 000 in the next [SEP]", "detok_text": "[CLS] to cars, hotels, food, and even handouts, \"he says. [SEP] i'll go on a sort of sled (i like the show) and feel guilty. [SEP] it was the sort of situation we're getting ourselves in - - we just put a couple of hoops and games in our heads. [SEP] we'd never had a bit of what happened,\" he said. [SEP] \" there are no guarantees that there will be as much change... as we expected - - but i have an idea of it happening. [SEP] the number will probably grow to about 100, 000 in the next [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] the news is over again, leaving him without a foot on the car. [SEP] and the answer never got to the end. [SEP] i was aware that my mind changed on the day when i arrived, that the woman had given access to me and all of the people. [SEP] that ' s interesting. [SEP] if i wait for 15 minutes before a concert, i will see him again ( i ' m sure i ' ll listen ). [SEP] it ' s a short - term problem, and it ' s never going to make it to a big game, \" he said. [SEP] \" we believe some of the things we found to [SEP]", "detok_text": "[CLS] the news is over again, leaving him without a foot on the car. [SEP] and the answer never got to the end. [SEP] i was aware that my mind changed on the day when i arrived, that the woman had given access to me and all of the people. [SEP] that's interesting. [SEP] if i wait for 15 minutes before a concert, i will see him again (i'm sure i'll listen). [SEP] it's a short - term problem, and it's never going to make it to a big game, \"he said. [SEP]\" we believe some of the things we found to [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] [SEP] \" i love the public option, but it ' s never been in the hospital, the brain, or the classroom, \" she said. [SEP] we would, well, turn the focus for years on the president. [SEP] of course, they will be allowed to claim \" they take a year ' s leave \" for charity, or \" try to make money \" for trying to buy a property on a scale which they think is \" fair tax. \" [SEP] marshall ' s attorney, stephen heine, said there is a lot of work to do on toe - to - toe litigation - - no one knows where the matter is [SEP]", "detok_text": "[CLS] [SEP] \"i love the public option, but it's never been in the hospital, the brain, or the classroom,\" she said. [SEP] we would, well, turn the focus for years on the president. [SEP] of course, they will be allowed to claim \"they take a year's leave\" for charity, or \"try to make money\" for trying to buy a property on a scale which they think is \"fair tax.\" [SEP] marshall's attorney, stephen heine, said there is a lot of work to do on toe - to - toe litigation - - no one knows where the matter is [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] 2010. [SEP] \" it is very sad, really, because sometimes you feel like you don ' t be careful and that ' s what it takes to be successful, \" she added. [SEP] four other vessels, including hundreds of crew members, were also also aboard. [SEP] in fact, they came with a host of different colors, from green dustwhies to rashes and the white redness of the brain ' s tissues. [SEP] i don ' t want to win, but i ' m on the other end. [SEP] i still want to finish school, even though i don ' t plan to leave. [SEP] the national [SEP]", "detok_text": "[CLS] 2010. [SEP] \"it is very sad, really, because sometimes you feel like you don't be careful and that's what it takes to be successful,\" she added. [SEP] four other vessels, including hundreds of crew members, were also also aboard. [SEP] in fact, they came with a host of different colors, from green dustwhies to rashes and the white redness of the brain's tissues. [SEP] i don't want to win, but i'm on the other end. [SEP] i still want to finish school, even though i don't plan to leave. [SEP] the national [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] ' s funny, but it ' s ridiculous, \" clinton told reporters on a flight from chicago to new york. [SEP] we always get the loose ball, so the result is very good. [SEP] \" i want to try to score more. [SEP] it didn ' t happen until the start of the season. [SEP] we ' re going to see that happen again. [SEP] in the past year, there have been reports of attacks, which rose to more than 1, 100 in 2008. [SEP] \" it ' s a day to talk to the world, \" he said. [SEP] the male driver of the car - - robert james, 32 [SEP]", "detok_text": "[CLS]'s funny, but it's ridiculous, \"clinton told reporters on a flight from chicago to new york. [SEP] we always get the loose ball, so the result is very good. [SEP]\" i want to try to score more. [SEP] it didn't happen until the start of the season. [SEP] we're going to see that happen again. [SEP] in the past year, there have been reports of attacks, which rose to more than 1, 100 in 2008. [SEP] \"it's a day to talk to the world,\" he said. [SEP] the male driver of the car - - robert james, 32 [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] willingness to step in to the public sphere. [SEP] you ' re just right, there ' s a lot to work out for you. [SEP] it is unlikely the next deal is due to be signed soon, because the costs are so high. [SEP] i know the first time i ' m not sure i ' m not going to make this happen to me, but at least i ' ve thought of myself. [SEP] as good as it sounds, he wants to go to high school, but that is still to go, a long way to go on a full - term career in virginia. [SEP] even though he ' s done much of [SEP]", "detok_text": "[CLS] willingness to step in to the public sphere. [SEP] you're just right, there's a lot to work out for you. [SEP] it is unlikely the next deal is due to be signed soon, because the costs are so high. [SEP] i know the first time i'm not sure i'm not going to make this happen to me, but at least i've thought of myself. [SEP] as good as it sounds, he wants to go to high school, but that is still to go, a long way to go on a full - term career in virginia. [SEP] even though he's done much of [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] they can make journeys between home and overseas. [SEP] meanwhile, cleveland ' s james brown and the celtics ' kevin garnett offered a sort of push for the nba title. [SEP] i am sure it looks like people will be dead at the end of their lives, \" she said. [SEP] 9 ( upi ) - - a study by u. s. health department officials found health systems in three states have a relatively high level of swine flu. [SEP] atlanta pushed the lead to 28 - 30 at the half - - including three of their nine 3 - pointers, including 4 - 1 1 / 2 minutes into the fourth [SEP]", "detok_text": "[CLS] they can make journeys between home and overseas. [SEP] meanwhile, cleveland's james brown and the celtics' kevin garnett offered a sort of push for the nba title. [SEP] i am sure it looks like people will be dead at the end of their lives, \" she said. [SEP] 9 (upi) - - a study by u. s. health department officials found health systems in three states have a relatively high level of swine flu. [SEP] atlanta pushed the lead to 28 - 30 at the half - - including three of their nine 3 - pointers, including 4 - 1 1/2 minutes into the fourth [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS] work relations and family relations. [SEP] the problem is very real. [SEP] the fate of the plant ' s owner, a nuclear official, is not to be known, but will be a critical component when the company reports at the start of the new year. [SEP] it also emerged that the victim did not know the government was ever involved in the case. [SEP] however, there is little time to go to work and create a new team. [SEP] i ' m sorry, but i do think it ' s important to read the whole story. [SEP] when i woke up, there was a restlessness of numbness, which was my reaction [SEP]", "detok_text": "[CLS] work relations and family relations. [SEP] the problem is very real. [SEP] the fate of the plant's owner, a nuclear official, is not to be known, but will be a critical component when the company reports at the start of the new year. [SEP] it also emerged that the victim did not know the government was ever involved in the case. [SEP] however, there is little time to go to work and create a new team. [SEP] i'm sorry, but i do think it's important to read the whole story. [SEP] when i woke up, there was a restlessness of numbness, which was my reaction [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] confident that the president ' s power would be used to protect the president ' s health, \" he wrote in remarks to reuters. [SEP] but the prime minister said she wanted to be reunited in the hands of a different administration. [SEP] i was there a few minutes later, looking very nice and he was having a lot of staches this time... [SEP] and so, i was much more concerned with the idea of a permanent solution to the problem of nuclear proliferation. [SEP] a spokesman said : \" \" i think we need to account for the payouts but we do not think we will get a deal when we go. [SEP]", "detok_text": "[CLS] confident that the president's power would be used to protect the president's health, \"he wrote in remarks to reuters. [SEP] but the prime minister said she wanted to be reunited in the hands of a different administration. [SEP] i was there a few minutes later, looking very nice and he was having a lot of staches this time... [SEP] and so, i was much more concerned with the idea of a permanent solution to the problem of nuclear proliferation. [SEP] a spokesman said:\" \" i think we need to account for the payouts but we do not think we will get a deal when we go. [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] she added. [SEP] if this really was a problem... we don ' t need one to make a reference to the \" nature of iran ' s nuclear program \" ( and israel ) that has nothing to do with u. s. policy, but we cannot wait for the west to do that now.... [SEP] \" we would come in, give them a good chance and make it a win, so if we were going to make a change, then we would take it later, \" he says. [SEP] a good place to make money? [SEP] the second step would be to replace the 47 - year - old [SEP]", "detok_text": "[CLS] she added. [SEP] if this really was a problem... we don't need one to make a reference to the \"nature of iran's nuclear program\" (and israel) that has nothing to do with u. s. policy, but we cannot wait for the west to do that now.... [SEP] \"we would come in, give them a good chance and make it a win, so if we were going to make a change, then we would take it later,\" he says. [SEP] a good place to make money? [SEP] the second step would be to replace the 47 - year - old [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] a lender has to take a credit - card account. [SEP] but the organisation ' s appeal comes only two weeks after thousands of people killed or injured in violence. [SEP] \" the president will get out of the way again, he can find what he knows a bit, what to get in there, \" he said. [SEP] and that is not a great result. [SEP] if you are playing for the australian team you will probably have to wait for the opportunity. [SEP] but that has not happened in mexico, and the authorities expect them to be able to contact the rest of the population. [SEP] it is not unusual for me to think [SEP]", "detok_text": "[CLS] a lender has to take a credit - card account. [SEP] but the organisation's appeal comes only two weeks after thousands of people killed or injured in violence. [SEP] \"the president will get out of the way again, he can find what he knows a bit, what to get in there,\" he said. [SEP] and that is not a great result. [SEP] if you are playing for the australian team you will probably have to wait for the opportunity. [SEP] but that has not happened in mexico, and the authorities expect them to be able to contact the rest of the population. [SEP] it is not unusual for me to think [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] points. [SEP] he has refused to disclose the details of the scope of his investigation, but insisted that he did not know the nature of the risk he would be released in prison for life. [SEP] a spokesman for the school system could not immediately be reached. [SEP] going to haiti was, well, not - for - a - goal. [SEP] in her life, he said, the girls seemed to have sex when they had no choice. [SEP] i don ' t let the doctor tell your friend, friend or brother, the money you make when you feel stupid is to make the money. [SEP] there ' s some things to look into [SEP]", "detok_text": "[CLS] points. [SEP] he has refused to disclose the details of the scope of his investigation, but insisted that he did not know the nature of the risk he would be released in prison for life. [SEP] a spokesman for the school system could not immediately be reached. [SEP] going to haiti was, well, not - for - a - goal. [SEP] in her life, he said, the girls seemed to have sex when they had no choice. [SEP] i don't let the doctor tell your friend, friend or brother, the money you make when you feel stupid is to make the money. [SEP] there's some things to look into [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS]. [SEP] the two had offices, conference facilities and apartment buildings, and that could not be confirmed. [SEP] a surprise decision to replace india ' s toyota as the world ' s largest automaker has lost millions of jobs. [SEP] he ' s a democrat, he ' s built into a business. [SEP] no working group has been able to raise this amount, but at least he ' s been able to do it. [SEP] the official said the executive committee at the end of the summit has been working with the u. s., russia and china to make a case against the move. [SEP] the meeting took place as early as a [SEP]", "detok_text": "[CLS]. [SEP] the two had offices, conference facilities and apartment buildings, and that could not be confirmed. [SEP] a surprise decision to replace india's toyota as the world's largest automaker has lost millions of jobs. [SEP] he's a democrat, he's built into a business. [SEP] no working group has been able to raise this amount, but at least he's been able to do it. [SEP] the official said the executive committee at the end of the summit has been working with the u. s., russia and china to make a case against the move. [SEP] the meeting took place as early as a [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] something we didn ' t want, \" he said. [SEP] officials said the driver left shortly after the crash and was allowed to leave for the morning shift. [SEP] the best way for them is make sure they do not keep it safe. [SEP] so it ' s not a bad start. [SEP] \" that could give me problems, \" he said. [SEP] at the end of the year, that number will be about 13. [SEP] we have to use the opportunity to try to change the past and find the way to the future. [SEP] i, however, have a little connection with mr. nader....... [SEP]", "detok_text": "[CLS] something we didn't want, \"he said. [SEP] officials said the driver left shortly after the crash and was allowed to leave for the morning shift. [SEP] the best way for them is make sure they do not keep it safe. [SEP] so it's not a bad start. [SEP]\" that could give me problems, \" he said. [SEP] at the end of the year, that number will be about 13. [SEP] we have to use the opportunity to try to change the past and find the way to the future. [SEP] i, however, have a little connection with mr. nader....... [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS] \" i was going to see one of them, not going to see that one \" at a time, he said. [SEP] \" if there ' s something that is going to be done, and we ' ve all agreed that we ' ll be able to take it, i think there ' s something we can do, \" scurry said. [SEP] i guess we are trying to change that. [SEP] ryan smyth ' s goal tied the scoreless at 2 - 2 with 3 : 05 left in the first. [SEP] more than 1, 200 people were injured in the crash, which killed 13 people between 2004 and 2006. [SEP] [SEP]", "detok_text": "[CLS] \"i was going to see one of them, not going to see that one\" at a time, he said. [SEP] \"if there's something that is going to be done, and we've all agreed that we'll be able to take it, i think there's something we can do,\" scurry said. [SEP] i guess we are trying to change that. [SEP] ryan smyth's goal tied the scoreless at 2 - 2 with 3: 05 left in the first. [SEP] more than 1, 200 people were injured in the crash, which killed 13 people between 2004 and 2006. [SEP] [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] don ' t think it is going to be like having make - up cheques in your car. [SEP] but if he ' s right, he ' s a coward. [SEP] and, well, well, we ' re going to know he ' s dead... and we don ' t have too much for him in jail. [SEP] \" i don ' t like to be the wrong person, but i think it ' s her job to be honest, \" she said before t. o. c. asked if her life had changed. [SEP] this is expected to total approximately $ 50 million in 2008 - 2010. [SEP] it [SEP]", "detok_text": "[CLS] don't think it is going to be like having make - up cheques in your car. [SEP] but if he's right, he's a coward. [SEP] and, well, well, we're going to know he's dead... and we don't have too much for him in jail. [SEP] \"i don't like to be the wrong person, but i think it's her job to be honest,\" she said before t. o. c. asked if her life had changed. [SEP] this is expected to total approximately $50 million in 2008 - 2010. [SEP] it [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] and we regain their independence. [SEP] john leahy, head of securities brokers, said the company ' s results have helped investors to focus on their options given the current economic environment. [SEP] \" i usually have a job with a large group, where i have to do a job, sometimes for at least a year to a year, \" he said. [SEP] \" it would be a political stunt. [SEP] the heat won two games in the series, which ended after the season started going 2 - for - 5. [SEP] the pirates took off with a two - 0 run. [SEP] i cannot also look at other activities here. [SEP] [SEP]", "detok_text": "[CLS] and we regain their independence. [SEP] john leahy, head of securities brokers, said the company's results have helped investors to focus on their options given the current economic environment. [SEP] \"i usually have a job with a large group, where i have to do a job, sometimes for at least a year to a year,\" he said. [SEP] \" it would be a political stunt. [SEP] the heat won two games in the series, which ended after the season started going 2 - for - 5. [SEP] the pirates took off with a two - 0 run. [SEP] i cannot also look at other activities here. [SEP] [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] may have to pay other costs for their homes. [SEP] the family said they were trying to get a lawyer. [SEP] he was expected to return from his holiday when he returned to britain at the end of april. [SEP] associated press writer suna deby in nairobi, kenya contributed to this report. [SEP] when we focus on each other, we have a different response in which we respond to all of our problems. [SEP] after all, we have no jobs. [SEP] he retired at the end of the season in his second year in less than a year with the new york jets but he hasn ' t been with the packers. [SEP] he [SEP]", "detok_text": "[CLS] may have to pay other costs for their homes. [SEP] the family said they were trying to get a lawyer. [SEP] he was expected to return from his holiday when he returned to britain at the end of april. [SEP] associated press writer suna deby in nairobi, kenya contributed to this report. [SEP] when we focus on each other, we have a different response in which we respond to all of our problems. [SEP] after all, we have no jobs. [SEP] he retired at the end of the season in his second year in less than a year with the new york jets but he hasn't been with the packers. [SEP] he [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS], we now have a focus on what we have to do. [SEP] that said, if you want to convene his position at this point he ' ll make a decision at this point to take stock in the company. [SEP] however, both companies have been forced to change the law to try to protect themselves against the recession. [SEP] she ' s only 18 years old, and she ' s over four years. [SEP] it is still running out of money and just doesn ' t seem to know much. [SEP] \" i ' m confident the next president will resolve the problem, \" he said. [SEP] that ' s what we need [SEP]", "detok_text": "[CLS], we now have a focus on what we have to do. [SEP] that said, if you want to convene his position at this point he'll make a decision at this point to take stock in the company. [SEP] however, both companies have been forced to change the law to try to protect themselves against the recession. [SEP] she's only 18 years old, and she's over four years. [SEP] it is still running out of money and just doesn't seem to know much. [SEP] \"i'm confident the next president will resolve the problem,\" he said. [SEP] that's what we need [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] co. [SEP] the border wall, which stands out on a concrete strip on the other side of the border, is now closed. [SEP] that ' s pretty much in itself. [SEP] it was a lot of fun. [SEP] it would have been easier to write off. [SEP] overtime _ 2, detroit, min, min ( hooking ), 17 : 08 roy, min ( hooking ), 18 : 08. [SEP] associated press writer anne gearan in washington contributed to this report. [SEP] \" the rest of the tour is all i can and it forces me to get back and get the race there, \" she said. [SEP] [SEP]", "detok_text": "[CLS] co. [SEP] the border wall, which stands out on a concrete strip on the other side of the border, is now closed. [SEP] that's pretty much in itself. [SEP] it was a lot of fun. [SEP] it would have been easier to write off. [SEP] overtime _ 2, detroit, min, min (hooking), 17: 08 roy, min (hooking), 18: 08. [SEP] associated press writer anne gearan in washington contributed to this report. [SEP] \"the rest of the tour is all i can and it forces me to get back and get the race there,\" she said. [SEP] [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] the game - clincher at 2 - 3, scored on a power play just 22 minutes in the second period. [SEP] they may have turned his face on the subject, put in an interview and, with a smile, focused for days on the image of himself in the face. [SEP] \" we are used to the leadership of the army. [SEP] i only was able to walk when i was in the middle of the night and thought i could have been standing in the tunnel. [SEP] donaghy said the league ' s decision does not comment on its decision. [SEP] his father reportedly died in december. [SEP] after india ' s elections [SEP]", "detok_text": "[CLS] the game - clincher at 2 - 3, scored on a power play just 22 minutes in the second period. [SEP] they may have turned his face on the subject, put in an interview and, with a smile, focused for days on the image of himself in the face. [SEP] \" we are used to the leadership of the army. [SEP] i only was able to walk when i was in the middle of the night and thought i could have been standing in the tunnel. [SEP] donaghy said the league's decision does not comment on its decision. [SEP] his father reportedly died in december. [SEP] after india's elections [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] home to a home with her 7 - year - old son. [SEP] the letters were only \" written in the united states, \" according to national intelligence officials. [SEP] for that part of the day, president obama, who felt he had to make another big shift in the campaign, was a little far from in the right position for the region. [SEP] \" he needs to be a better for the team, \" said a source. [SEP] last year he issued 2, 035 orders in january. [SEP] the shows will air on the discovery channel and other shows next year. [SEP] it may seem to me at the top of this table [SEP]", "detok_text": "[CLS] home to a home with her 7 - year - old son. [SEP] the letters were only \"written in the united states,\" according to national intelligence officials. [SEP] for that part of the day, president obama, who felt he had to make another big shift in the campaign, was a little far from in the right position for the region. [SEP] \"he needs to be a better for the team,\" said a source. [SEP] last year he issued 2, 035 orders in january. [SEP] the shows will air on the discovery channel and other shows next year. [SEP] it may seem to me at the top of this table [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] iraq, according to a recent report in the post. [SEP] mr. sandro is left by the end of the story, leaving him in the car, going off for hours - if not minutes - - in his hands. [SEP] \" we are looking for a long - term extension of this strategy. [SEP] \" our differences are great and i do not want to be alone. [SEP] \" i know, the first time he started it, i would tell him to take him, it was always hard to pick a player after him, so i don ' t know if he could make up his mind. [SEP] \" i don ' t [SEP]", "detok_text": "[CLS] iraq, according to a recent report in the post. [SEP] mr. sandro is left by the end of the story, leaving him in the car, going off for hours - if not minutes - - in his hands. [SEP] \"we are looking for a long - term extension of this strategy. [SEP]\" our differences are great and i do not want to be alone. [SEP] \"i know, the first time he started it, i would tell him to take him, it was always hard to pick a player after him, so i don't know if he could make up his mind. [SEP]\" i don't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/summary.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/summary.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..6aa61aebf27690f0e5eef48ca4ff653ffcc7863c --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/summary.jsonl @@ -0,0 +1,2 @@ +{"type": "summary", "name": "state_c256_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c256_t1p45", "steps": 256, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 29.81545187350111, "nll_per_token": 3.3950267783717107, "tokens": 9500}, "diversity": {"sample_entropy": 4.085741040367163, "unique_tokens": 1473, "token_count": 8192, "distinct_1": 0.1798095703125, "distinct_2": 0.5905511811023622, "top_token_mass": 0.0538330078125}} +{"type": "summary", "name": "state_c1024_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c1024_t1p45", "steps": 256, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 28.415282971033125, "nll_per_token": 3.3469271332084953, "tokens": 9529}, "diversity": {"sample_entropy": 4.048794239038511, "unique_tokens": 1473, "token_count": 8192, "distinct_1": 0.1798095703125, "distinct_2": 0.5878444881889764, "top_token_mass": 0.057861328125}} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/summary.tsv b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/summary.tsv new file mode 100644 index 0000000000000000000000000000000000000000..1628c573d6c688a8ef7660c2bb157bd5554713e4 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_256steps_n64/summary.tsv @@ -0,0 +1,3 @@ +name step detok_genppl sample_entropy distinct_2 top_token_mass model_t_mode support_power semantic_power final_from endpoint_temp concentration_max update +state_c256_t1p45 124000 29.81545187350111 4.085741040367163 0.5905511811023622 0.0538330078125 post 1.0 1.0 state 1.45 256.0 resample +state_c1024_t1p45 124000 28.415282971033125 4.048794239038511 0.5878444881889764 0.057861328125 post 1.0 1.0 state 1.45 1024.0 resample diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/state_c1024_t1p45_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/state_c1024_t1p45_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..12540895c9caffff1265269f74a2e1cebb08991e --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/state_c1024_t1p45_detok_raw_samples.txt @@ -0,0 +1,228 @@ +state_c1024_t1p45_detok +{ + "type": "summary", + "name": "state_c1024_t1p45", + "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", + "step": 124000, + "decode": { + "kind": "categorical_fullvocab", + "config": "state_c1024_t1p45", + "steps": 16, + "model_t_mode": "post", + "support_power": 1.0, + "semantic_power": 1.0, + "endpoint_temp": 1.45, + "concentration_min": 1.0, + "concentration_max": 1024.0, + "final_from": "state", + "update": "resample", + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 24.348744185198743, + "nll_per_token": 3.1924802746955083, + "tokens": 7297 + }, + "diversity": { + "sample_entropy": 2.0679188483539344, + "unique_tokens": 615, + "token_count": 8192, + "distinct_1": 0.0750732421875, + "distinct_2": 0.23363681102362205, + "top_token_mass": 0.392578125 + } +} + +===== sample 000 ===== +[CLS], chicago, chicago, chicago, and,, we get a list - chicago,,, chicago,,,,, chicago, chicago, michigan, chicago,, and more. [SEP] goal of. thomas 14 - 0. 7. - 13, inc. - - michigan, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago,,, chicago,,,,,,,, illinois,, chicago, illinois, chicago, university of michigan, ohio. michigan, michigan, ohio,, michigan, michigan, ohio, ohio,, ohio, ohio, michigan, and [SEP] + +===== sample 001 ===== +[CLS],,,,,, 50, 50, 48,,, 50,,,, 51,,,,,,,, etc. [SEP] the list is 50,,,,,,,,, etc. [SEP] 14,,, 13, 15, 17, 15, 17, 15, 17,, 15, 17, 16, 16,, 13, 14, 14.,, 14, 13, 14, 14 -,,,,,, 26, 37, 37, the other end of the road, 37, 37, 37,,,, 37,,, 37,, [SEP] + +===== sample 002 ===== +[CLS], 2004, 2005,,,,,,, 2006 and 31, and, respectively. [SEP] scutton has 1. 6,,,,,,,, and 2. 5, 7, 14,,,,,,,,,,,,,, 4, etc. [SEP] the firm includes in chicago, chicago,,, % in the region, 50 %, and 50 % in the conference, chicago, chicago, chicago, chicago, chicago, chicago,,, chicago. [SEP] the state - run company already already has more than $40bn in debt assets. [SEP] the collapse in confidence [SEP] + +===== sample 003 ===== +[CLS] of the country,,,,,,,,,,,,,, country,,,, the city, state, city, city,, city, and region. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, in the,,,,,,,,, and,,,,,,,,,,. [SEP] in and of - - ohio, illinois, illinois, illinois,,,, illinois, illinois, illinois, illinois,,,,,,,,, [SEP] + +===== sample 004 ===== +[CLS] the moment of 1893, just over 500 square feet of the piece, the plane was a a point - down on the side of the fuselage. [SEP] he said he was taught the concept of the idea that people would have have to what what not not have have together. [SEP] thec originates, develops and has offices in chicago, chicago, new york, chicago, mid - chicago,, york, chicago, chicago, chicago, and in the us, uk,,,, and, and. [SEP] in chicago, detroit, the penguins, bulls and the white, in chicago, the power have the only -,, of [SEP] + +===== sample 005 ===== +[CLS]. s. raleigh, n. d., thousands of the players have,,, - - chicago, chicago, chicago, chicago,,,,,,,,,,, have have [CLS] in the end of the season to send him back to the basket in the the playoffs. [SEP] the them with the butter in place. [SEP] the man is is right in the back, - in the back and, of course, in the back of the time - - - and, in fact, he is about to sign to a new world record. [SEP] the answer was have about the beijing. [SEP] the rest of the [SEP] + +===== sample 006 ===== +[CLS],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and, in the rest of the day,,,,, and,. " [SEP] the winner, the,,, has the time, time and place to stand in the,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP], -,,,,,,,,,,,, of,. [SEP] a few chunk of thes between the clock and the.. [SEP] + +===== sample 007 ===== +[CLS]1. 9 - - - - - - - - - - - - - - - - - - - - - - - - - - - 14. - - - - - - - - - - pb11. - - - - - - - - - - - - - - - - - 14, 2009, - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - [SEP] + +===== sample 008 ===== +[CLS] to shove her in the face. [SEP] the,,,,, the linens,,, the planes, the wagons, the planes, according to the chicago,,,,,,. [SEP],,,,,,,,,,,,,,,,,,,,,,,. [SEP] two - thirds of the fans will have to get on the road to win the championship game. [SEP] i mean, to,, to,,,,, the road,,,,,, the country,,,,,,,, and give you the name, " he said. [SEP] + +===== sample 009 ===== +[CLS],,,,,,,,,,,,,,,,, end of the day.,,,,, in,,,,,,,,,,,,,,,,. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] we have have have have,, have have have have for.. [SEP] the rockets, as if they were an awful team [SEP] + +===== sample 010 ===== +[CLS] - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 74, 17 - 14 - 14 - - - - - - - - - - - - - - - - - - - - - - - - - - -, 73 - - - - - - -1, 112 -, - 31, 68 - 14, 68 - 14 to the end - - - - - - - - - - - - - - - - - - - - - - - - [SEP] + +===== sample 011 ===== +[CLS], 37,,,, 37, 37, 37, 37, 37,,, 37, 37,,,,,,,,,,,,,,,,,,,,,,,,,, and back - to - back in the period of december 31, 2008 are,,,,, 36 -,....,, three weeks to date, to end the week,,,,,,,,,,,,,, 37, 37, days in the week of week -,,,,,,,,,,,,,,,, [SEP] + +===== sample 012 ===== +[CLS],,,, turn - of - road,,,,,,,,,,.,,.,, to the line -,,,,,,,,,,, to turn to the line,,,,,,, and, to the end, period. [SEP] to 52, turn, the turn - to -,,, - to. turn - in - turn, to the next - turn, the next,,,,, etc.,,,, the beginning,,,.,.,,, 14, 15 -,, 14, 15, 14.. [SEP] + +===== sample 013 ===== +[CLS] the same said. [SEP] in the end,,,,,,,,,,,,,,,,,,,,, of the whole future. [SEP] "i think we know, we will be happy soon," he said. [SEP] and up the whole,,, the breadbaskets,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP] + +===== sample 014 ===== +[CLS] - 17 - 16, 18 - 16 - 17 - 2 - 16 - 31 - - 6 - 14 - 17 - 14 - 14 - - - - 1 - 72 - 17 - 2, 21, 49 -, 31 -, - - 16 - 31 -,, 11, 731, 13, 31 -, -, 14 - 16 - 14 - - - - - - - - - - - - - - 14 - 16 - 112. - - - - 17 - 16 - 13, 16 - 14 - 48 -. - - - - - - - - - - - - - - - - - [SEP] + +===== sample 015 ===== +[CLS], michigan, michigan, michigan, michigan, michigan, michigan, the district, chicago, michigan, michigan, michigan, illinois,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and on. [SEP] the companys was headquartered in college city, ill. [SEP] 14, 2007. [SEP] in boston, boston, the bostons, the, the the..... [SEP] the huskies set up a 14 - 14 run [SEP] + +===== sample 016 ===== +[CLS] have have time to begin the process of finding a deal. [SEP] the end of the letter refers to a series of a - 52, i. u. s., to the,,,,,, a. c. a., of the,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] " they have,,,,,,,,, [SEP] + +===== sample 017 ===== +[CLS],, chicago, chicago, chicago, etc. [SEP] the usa,,,,,,,,,, the usa, the usa,,,,,,,,,,,,,,,,,, etc. [SEP] but for the,,,,,,,,,,,, have way out of the question. [SEP] in the cities of chicago, chicago, chicago, chicago. [SEP] but it didn't matter. [SEP] the have have have, they that they back to - - chicago, boston,,,,,,,, etc. [SEP] and happens, no. [SEP] the [SEP] + +===== sample 018 ===== +[CLS] europe, canada, the u. s., canada to canada and canada. [SEP] a have have have have have here in moscow. [SEP] of course, they don't bring in the money to have them the door. [SEP],,, chicago, chicago, chicago,, the district,, chicago,,,,,,, chicago to chicago, chicago to chicago, bhut, chicago, chicago, chicago,.........., chicago, chicago, chicago,,,, chicago, chicago, chicago, chicago, chicago,,,,,, and to chicago. [SEP] [SEP] + +===== sample 019 ===== +[CLS] 81, 89, 89, 89. [SEP] period, 2008 - the company's 73, 73, 73,,,,,,,,, 37,,, 37,, 37,,,,, 36,,,, 18 - 37, 23 - 37,, 37, 36, 37, 37, 37, 37, 37,..,.,,,,,, 49, 73, 54,. 5.,. 37, 37, 48, 48, 31, 48,,, 37,,,,,,,,, 31 to 38. 50,... [SEP] + +===== sample 020 ===== +[CLS] - - chicago,,,, c.,,,,,,, district of chicago, chicago, chicago, chicago, cleveland,,,,,,,,,,,,, cleveland, and, and in akron, ohio, and ohio. [SEP] the balance line is in addition to the company's,, 50, 49, 49 -,,, 38, 50bp, 52 -, -,,, of, respectively. [SEP] and, in the first game of the season, it's a 14 - 14 season that has a 1 - 3 points in the first two minutes. [SEP] [SEP] + +===== sample 021 ===== +[CLS],,,,,,,,,,,,, for all. [SEP] " it doesn't really matter to the,,,,,,,,,,,,,,,,,,,,,, etc. [SEP] they have have,, and.. [SEP] i think it is,,,,,,,,,,,,,,,, of the day,,,,,,,,,,,,,,,,,,,, to the end. [SEP] the same of of of of,,,,,,,,,,,, [SEP] + +===== sample 022 ===== +[CLS].. [SEP],,,,,,,,,,,,,,,,,,. [SEP] and, say, the leaders of the world,,,,,,. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP] + +===== sample 023 ===== +[CLS], 48, 52, 48,,,,.,,,,,,, 48,,,,,,,,,,,, 48, and, of the region, and region of the uk and region,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and, etc., in the week,,,,,,, the day of the week, the region, the year, number of,,,,,,,,,,,, [SEP] + +===== sample 024 ===== +[CLS] to make up a meal by putting their heads on a table... [SEP] in the end. [SEP] the house would cost at $14, 000. [SEP] the question of unity is for unity, but not is unity, " sadr added. [SEP] the pope is not not way to the house of dreams. [SEP] the one is is in the door. [SEP] as he said, chicago, chicago, chicago, chicago, chicago, chicago, chicago, and chicago. [SEP] for them, the haves and,s and,s,ss, and and and ands and for have thes in the field. [SEP] [SEP] + +===== sample 025 ===== +[CLS] what a person can do. [SEP] of words, they never know it, no,,s, etc., oy, drugs, rest,,y,,, to say,,, no,,, a little bit. [SEP] ( by aboutt communications technologies, inc. [SEP] the bulls is have the,,s,,,,s, but there are no moreys in the uy..... [SEP] and the one,ing,sss in the corner... [SEP] the curious - -,,,,, y, pre,,,,s - - all [SEP] + +===== sample 026 ===== +[CLS] 14 - 14 - 14 - 14 - 1. 16 -yyyy -y - 14err 1. 16 -y - 14. [SEP] by -eryyyyyy - 14 % &yyyyyy - 16 % traily - o - 16y - ey - eh - 16yy -yyyyyyyyyyyy - - oyyyyyyyyn - 14yyyyyyyy - 14yyyyyyyyyyyyyyyyyyy [SEP] + +===== sample 027 ===== +[CLS] - - - - - - - - - - - - - - - - - - - - - - - - - - - - - to - date. - - - - - - - - - - - - - - - - - - - - - - - - - period of - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - [SEP] + +===== sample 028 ===== +[CLS]77 - 6077777, 7677117, 76771, 7651777111, 76317877 - 49731, 7677777,734, 767726, number771171 - 0777220792., 49777, 7671, 49 - 49 - 49, 49 - 49 - 49 - 49 - 37 -,7 - 49 - 49 - 49, 7371, 49 - 37 - 49 - 49 - 547 - 48 - 48 - 49 [SEP] + +===== sample 029 ===== +[CLS] detroit, detroit, detroit, the knicks, detroit, detroit, detroit, detroit, chicago were the best teams of the day. [SEP] the list comes in the names of the chicago, detroit, chicago, boston,, chicago, chicago, and and the others. [SEP] but the list is chicago, chicago, chicago, chicago, chicago, chicago, illinois, said david chesney, a political commentator. [SEP] the date for the hearing is set for jan. [SEP] jacobs returned to the jets last season with two injuries. [SEP] when a full - was was springing to the wall at the end of chicago, the chicago was [SEP] + +===== sample 030 ===== +[CLS] the game. [SEP] he will have a good time in the senate. [SEP] results in the later parts of the year, boston, period, 2008. end - to - end,, 21 and 37,,,,,, s. a., 18 - 14, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago and chicago, chicago, region, boston, chicago, st. chicago, michigan, chicago, chicago, the district,,,,,, and on the continent,. - - chicago, chicago, chicago, chicago, a.,,, etc. [SEP] the [SEP] + +===== sample 031 ===== +[CLS]................. [SEP] ( :101.y ( ( ( ( ( (7, 500). [SEP] 2479. 1......................... [SEP] by. oh, 247....................................................... [SEP] + +===== sample 032 ===== +[CLS],, period, 50, etc. [SEP] indiana,,,, 50,,, - region, region, region,, 37,,, 50, 89. [SEP] chicago, ohio, chicago, chicago, illinois, illinois,,,,,,,,, $1, 000, 000. [SEP] region, region, region, region, region, multi - area, region, region, region,,, area, chicago, region, chicago, region, area, area, region,, area, region, region,, region, region,, region, region, region, region - region, region, [SEP] + +===== sample 033 ===== +[CLS]s, o,,,,,,,,,,,s. [SEP] the concept is that the,,,,,,,,,,,,,,,,,, mt. [SEP] the,,,,,,,,,,,,,,,,,,,, is effortless. [SEP] the bulls,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] the,,,,,,,,,,,,,, [SEP] + +===== sample 034 ===== +[CLS],,,,,,,,,,,,,,,,,,. [SEP] and all they wanted to stand out the door on the day, day, day, the end of the day.,,,,,, to,,,,,,, - - and perhaps in the day of days. [SEP] the industry's leading companies are private and and construction workers in the united states, michigan, michigan, chicago, michigan, michigan, michigan, michigan, north carolina, ohio, illinois, ireland. [SEP] gates is also dedicated to explaining how the situation was changed in the early soviets. [SEP] [SEP] + +===== sample 035 ===== +[CLS] % to 509 points. [SEP] 3 - 14 - - - - - - -, - 11 - 24 - 11 -, j. 14 - 14 - 16 - 14 - 14. to mid - table 14. 5 - 11, 16 - 14.. 12 - 14 - 14 - 14. - - 14, 16, 16, 16 -,... [SEP] (ap) cnn's doug klein, greg barrett and jan karsak contributed to this report. [SEP] instead, they went back to the house, with a partition back on the road. [SEP] the 20 - year - old, a 14 - [SEP] + +===== sample 036 ===== +[CLS],, 49,,,,,, 70, 73,,, 73, 73, 73, 73, 89,, 73, 73, 70, 70,,,,, w.,, 89, 89,, 70, 73, 73, 50, 73, 54, 73, 57, y,... of the period,,,,,,,,,,,,,,,,,, and, of the entire of group. [SEP] east city, chicago, chicago, oct. [SEP] for a total of 1, 50,,,,,, 37, 37,, [SEP] + +===== sample 037 ===== +[CLS], 112 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -, 17 - 14 - - - - - 14 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - less than 60 % - - - - - - - - - - - - - - [SEP] + +===== sample 038 ===== +[CLS]... [SEP] number of students,,, 13, 20098, and - 112. - - 14, 2009 - - - - - - - - - - - - - - - for a three - game series. - - - - ticker - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - i'm - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - [SEP] + +===== sample 039 ===== +[CLS],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and,,,,,,,,,,,,,,,,,, and of the,,,,. [SEP] the me,,,,,,.,,,, a,,,,,,,,,,,,,,,,,,,,,,,, etc. [SEP] the of are s [SEP] + +===== sample 040 ===== +[CLS] there are still a number of questions about the payout of british employees. [SEP] "the meeting happened in the middle of the day, at the the hour.... later in the day," the paper said. [SEP] the....................... [SEP] a byy,,,,,, chicago,,,,fl,,,,y,usa,,,her, bisty,st,y,,,, to guide,,.,,,,utions, and,,,, [SEP] + +===== sample 041 ===== +[CLS] 2 0. s 1, n7, 1, n.......... 2, n..... 247. 2 n dice to.... 2.1, n.11.11 to.. [SEP] n..7... dice1, s. n...s in n.............. 2171, 247................................ [SEP] + +===== sample 042 ===== +[CLS] the road, a,,,,,,,,,, access to the road. [SEP] thes, boston, detroit, chicago, chicago, chicago,, chicago, chicago,, detroit, chicago, chicago. [SEP] cleveland, chicago 11, 15 - 15 chicago, 11 - chicago, 13 - 14, detroit, n. a. 14, detroit 11, detroit 11, 13 - 14, n., 11, 11 - 14, 11 - 13,... [SEP] [SEP] schools were closed in some areas. [SEP] "of course, no," the hotel manager told us. [SEP] the company, which [SEP] + +===== sample 043 ===== +[CLS] games. [SEP] the company includes in michigan, michigan, michigan of illinois, illinois, illinois, illinois, michigan,,,,,,,,,,,,, michigan, ohio, illinois, michigan, ohio, and. [SEP] the number of the economy by growth was 0. 4 % in the same quarter in the third quarter of 2008. [SEP] lansing, mich. - - in the middle of the day, down the road, you have to be able to do a good job, even if the road will be worse. [SEP] police say the man was was a, and, and - in road with the [SEP] + +===== sample 044 ===== +[CLS] - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -. - - - - 31 - 31, 37,, 31, 37, and other - - - - - - - - 31 - 14 - - - - - - 31 - 31, 31 - -, 31 -, - - -, -, - - - -, 73 - 37, 31 - 31, 73 - 31 in december 2007, 08 to end 2009, total of $582 million (2007 to - 08) to 1128 in the coming [SEP] + +===== sample 045 ===== +[CLS] the red region. [SEP] there have been heavy showers at several venues in the past two years. [SEP] the car is right in place, and on the back of the road, at the end of the road. [SEP] mr brown said it would have said that the number of jobs and jobs in the uk was to be increased. [SEP] for a "collapse" of the economy. [SEP] the firm is more by, 500 employees with offices in onsite chicago, chicago,, chicago,, chicago, chicago,, chicago, new york, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, [SEP] + +===== sample 046 ===== +[CLS],,,,,,,,,,,,,,,,,,,, in the middle,,,,,,,,,,,,,,,,,,, and,. [SEP] in fact, the american team the most should have in vancouver - - the first trip to the top of the table. [SEP] the game resulted in a combination of chicago, chicago,,,,, and,,,,, and then, according to the detroit - boston game, a 49 - point thriller by the two teams,,, chicago, that has lasted more than 100 minutes. [SEP] [SEP] + +===== sample 047 ===== +[CLS],,,,, 14,,. [SEP],,, michigan, michigan,,, illinois,,,,,,,,,,,,,,,,,,,,, illinois,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] the panel, taking on members of the uk, uk, france, canada,,, france, most of the uk,,,,,,,,,,,,,,,,,,,,, and,,,,, [SEP] + +===== sample 048 ===== +[CLS], period, days, but not days, period, period, to period,, period, period, to period and period at the cost of a week,, period, period, period to, period, period,,,,, period, the same, period, period, period, and,, to period, period to period.. period, period, period, period, period, and a week at the same period, period, period, 30 days at the end, period, days, period, period,, days to each of, and days, 30 days, beginning with,,, beginning, the [SEP] + +===== sample 049 ===== +[CLS], s, s,, s, s, s. [SEP] s, s, s, s, s,, s, s in d, s, s, s, s, s, s, s s, s, s, s, s, in and d. [SEP] s, s, s s, s s, s, s, s, s, s, s, s,, s,,, s, s, s, s, s. [SEP] d,, s, s, s,, s, s, s, s,, and.. [SEP] s, s, s [SEP] + +===== sample 050 ===== +[CLS], -.... 51, 53,,,,.... [SEP],, 50, 50, 50,,,,,,,,, and,,,,,,,,,,,,,,,,, the non - and, of the year -,,,,,,,,,,,. [SEP] in the name of, -,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, -,,,,,,, the kind [SEP] + +===== sample 051 ===== +[CLS].. we are a, -,,,,,,,,,,,...,,,,,,,,,,,,,,,,, w.,.,,,,,,,,,,,,,,,,,,,,,,, and,.,, calculates,,,,,,,,,,,,,,,,,,,,.,,,,.... the e - u has a range of,,,,,,,,,,,.,,,,, [SEP] + +===== sample 052 ===== +[CLS] - - all in the final game of the season - - were confronted by someone in their car. [SEP] he told the rest of the group to get up to the back of the building, and a a and and out into the road. [SEP] "they will have have a way, he is going to give us a lesson." [SEP] a a a a... [SEP] the number would be $1, 000 by the end of the year, and a the, and and and andy of the sames. [SEP] on the point in the area, there are no people in the area, he said. [SEP] the [SEP] + +===== sample 053 ===== +[CLS], 37,,,,,, 21, 26, 26, 37,,,.,,,,,,, 2007. [SEP] for the period - 21, 26, 21, 31, 37, 31, chicago - -,, 26,,, 36,,,,,, 51, 48, 37,, 21, 37, 37, 37,, 37, 37,, 16,,, 14 - 16, 23,,, 14 - 16, 37, 48, 37,, 16 - 16, 16 - 14. -, 14,,,, 17, 37, 37, [SEP] + +===== sample 054 ===== +[CLS]'s,,,,........,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and,. [SEP] for that words, the likes of the oregon, chicago, illinois, illinois,,,,, are in the most back - to - back,,,, way. [SEP] the [SEP] + +===== sample 055 ===== +[CLS] out of the road, and a and and and have - the widening. [SEP] a few thing was out for nothing. [SEP] (ap) - china's economic would systems have a significant part of the world, in the north, and the rest of the world, according to the report. [SEP] in fact, the number of for for was of wass, [CLS] 14, 24,,, 2006 ). [SEP] the league's rookie all - star isn't the only one who seems to be on the court. [SEP] the company is expected to be 1, 000 jobs, and,,y said. [SEP] the [SEP] + +===== sample 056 ===== +[CLS] in and,, and and and and ). [SEP] dr. michigan, michigan, michigan, michigan, s.,., michigan, michigan, michigan, michigan, ohio, etc. [SEP] but, by the end of the year, the number will be to than 1 %. [SEP] by the time he was be out of the political again. [SEP] i'm not sure, but, have,,,,,,,,ical allss in the us, canada, texas and texas. [SEP]......,.,. and............ [SEP] + +===== sample 057 ===== +[CLS], period, time to time. week of december 1. period to. days in a number of days, week to days in a, period, period, period, period, period,, period. [SEP] it is period, period, period of the period, period, period. period, period, and period. week, period, period, period, period, period, period, period days, change of days, period, week of the same period, week. week, period, period, period, period,, day, period, period, period,. period,, period, period, in a, period [SEP] + +===== sample 058 ===== +[CLS] [SEP] the company continues to have a full year, year, year, year, and return to a full schedule. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP] + +===== sample 059 ===== +[CLS] addition, the rubber coat, comes with unique decorative flavors, such as the rubber coat and the purple mask. [SEP] he became more worried about any future, he said. [SEP] houston's loss to detroit in the final game of a series of road - game series. [SEP] i do want to leave the room for a long conversation. [SEP] once again, he knows how to do his job. [SEP] the answer will be limited to,,,,,,, at least. [SEP] they have the bottom end of the road,,,,,,,,,,,,,,,,,,,,, [SEP] + +===== sample 060 ===== +[CLS],,,,, period -,,,,,,,,,,,, and, end of the period, period,,,,,, period to period, period, and, period, period, period, period - period. the date,,,,,,,,,,, and, has the ability to track,,,, period, period, place, start to the year,,,,,,,,, and number of period. [SEP] in the end, the back - up eliminates the illusion of the in the end of the original structure. [SEP] he would have [SEP] + +===== sample 061 ===== +[CLS], chicago, chicago, chicago, end of the day, chicago,, chicago, chicago, chicago,,,,,, chicago, chicago,,,,, chicago, chicago,,, 37, 37, 36, week and the correspondingly beautiful days. [SEP] the third day of the day was marked by the remarkable talents of joe cowen. [SEP] for today, the week has moved from days,, days, days, to december,,, and december. [SEP] 21, 2007,, 2007, and the last 14 days of the year., 31,,,,,,, december, 2007. [SEP] + +===== sample 062 ===== +[CLS], will have been advised to take pre - trip flights due to non - cancellations. [SEP] multi - region, mid -,, day of north -, eastern, east - atlantic, east - atlantic, south -,,, mid -,, mid - atlantic, chicago, chicago, chicago, and chicago,,, western, chicago, and chicago, chicago, chicago, chicago, and,, chicago,,,,,, and chicago, north - to - north, u. s. 78, eastern, eastern, eastern,, and eastern, mid - atlantic, chicago,,,,, and. [SEP] + +===== sample 063 ===== +[CLS] have have have, in the confluence of the celtics and the pistons, and have the best is to the thes in the basket. [SEP] the a -yy, with ofs, and the, and the out of the sand and and, of a single basis. [SEP] the following included, atlanta, atlanta, chicago, chicago, boston, chicago, chicago, chicago, chicago, new york, chicago, etc. [SEP] chicago,, chicago, chicago, chicago, to,ca, 2004 - h2.... [SEP] the idea is is have, have and, with a few, and and and and. [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/state_c1024_t1p45_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/state_c1024_t1p45_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..28b7ab93026187bae514ec0dfff3d13ef6ac8ff5 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/state_c1024_t1p45_raw_samples.txt @@ -0,0 +1,228 @@ +state_c1024_t1p45 +{ + "type": "summary", + "name": "state_c1024_t1p45", + "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", + "step": 124000, + "decode": { + "kind": "categorical_fullvocab", + "config": "state_c1024_t1p45", + "steps": 16, + "model_t_mode": "post", + "support_power": 1.0, + "semantic_power": 1.0, + "endpoint_temp": 1.45, + "concentration_min": 1.0, + "concentration_max": 1024.0, + "final_from": "state", + "update": "resample", + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 24.348744185198743, + "nll_per_token": 3.1924802746955083, + "tokens": 7297 + }, + "diversity": { + "sample_entropy": 2.0679188483539344, + "unique_tokens": 615, + "token_count": 8192, + "distinct_1": 0.0750732421875, + "distinct_2": 0.23363681102362205, + "top_token_mass": 0.392578125 + } +} + +===== sample 000 ===== +[CLS], chicago, chicago, chicago, and,, we get a list - chicago,,, chicago,,,,, chicago, chicago, michigan, chicago,, and more. [SEP] goal of. thomas 14 - 0. 7. - 13, inc. - - michigan, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago,,, chicago,,,,,,,, illinois,, chicago, illinois, chicago, university of michigan, ohio. michigan, michigan, ohio,, michigan, michigan, ohio, ohio,, ohio, ohio, michigan, and [SEP] + +===== sample 001 ===== +[CLS],,,,,, 50, 50, 48,,, 50,,,, 51,,,,,,,, etc. [SEP] the list is 50,,,,,,,,, etc. [SEP] 14,,, 13, 15, 17, 15, 17, 15, 17,, 15, 17, 16, 16,, 13, 14, 14.,, 14, 13, 14, 14 -,,,,,, 26, 37, 37, the other end of the road, 37, 37, 37,,,, 37,,, 37,, [SEP] + +===== sample 002 ===== +[CLS], 2004, 2005,,,,,,, 2006 and 31, and, respectively. [SEP] scutton has 1. 6,,,,,,,, and 2. 5, 7, 14,,,,,,,,,,,,,, 4, etc. [SEP] the firm includes in chicago, chicago,,, % in the region, 50 %, and 50 % in the conference, chicago, chicago, chicago, chicago, chicago, chicago,,, chicago. [SEP] the state - run company already already has more than $ 40bn in debt assets. [SEP] the collapse in confidence [SEP] + +===== sample 003 ===== +[CLS] of the country,,,,,,,,,,,,,, country,,,, the city, state, city, city,, city, and region. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, in the,,,,,,,,, and,,,,,,,,,,. [SEP] in and of - - ohio, illinois, illinois, illinois,,,, illinois, illinois, illinois, illinois,,,,,,,,, [SEP] + +===== sample 004 ===== +[CLS] the moment of 1893, just over 500 square feet of the piece, the plane was a a point - down on the side of the fuselage. [SEP] he said he was taught the concept of the idea that people would have have to what what not not have have together. [SEP] thec originates, develops and has offices in chicago, chicago, new york, chicago, mid - chicago,, york, chicago, chicago, chicago, and in the us, uk,,,, and, and. [SEP] in chicago, detroit, the penguins, bulls and the white, in chicago, the power have the only -,, of [SEP] + +===== sample 005 ===== +[CLS]. s. raleigh, n. d., thousands of the players have,,, - - chicago, chicago, chicago, chicago,,,,,,,,,,, have have [CLS] in the end of the season to send him back to the basket in the the playoffs. [SEP] the them with the butter in place. [SEP] the man is is right in the back, - in the back and, of course, in the back of the time - - - and, in fact, he is about to sign to a new world record. [SEP] the answer was have about the beijing. [SEP] the rest of the [SEP] + +===== sample 006 ===== +[CLS],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and, in the rest of the day,,,,, and,. " [SEP] the winner, the,,, has the time, time and place to stand in the,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP], -,,,,,,,,,,,, of,. [SEP] a few chunk of thes between the clock and the.. [SEP] + +===== sample 007 ===== +[CLS]1. 9 - - - - - - - - - - - - - - - - - - - - - - - - - - - 14. - - - - - - - - - - pb11. - - - - - - - - - - - - - - - - - 14, 2009, - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - [SEP] + +===== sample 008 ===== +[CLS] to shove her in the face. [SEP] the,,,,, the linens,,, the planes, the wagons, the planes, according to the chicago,,,,,,. [SEP],,,,,,,,,,,,,,,,,,,,,,,. [SEP] two - thirds of the fans will have to get on the road to win the championship game. [SEP] i mean, to,, to,,,,, the road,,,,,, the country,,,,,,,, and give you the name, " he said. [SEP] + +===== sample 009 ===== +[CLS],,,,,,,,,,,,,,,,, end of the day.,,,,, in,,,,,,,,,,,,,,,,. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] we have have have have,, have have have have for.. [SEP] the rockets, as if they were an awful team [SEP] + +===== sample 010 ===== +[CLS] - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 74, 17 - 14 - 14 - - - - - - - - - - - - - - - - - - - - - - - - - - -, 73 - - - - - - -1, 112 -, - 31, 68 - 14, 68 - 14 to the end - - - - - - - - - - - - - - - - - - - - - - - - [SEP] + +===== sample 011 ===== +[CLS], 37,,,, 37, 37, 37, 37, 37,,, 37, 37,,,,,,,,,,,,,,,,,,,,,,,,,, and back - to - back in the period of december 31, 2008 are,,,,, 36 -,....,, three weeks to date, to end the week,,,,,,,,,,,,,, 37, 37, days in the week of week -,,,,,,,,,,,,,,,, [SEP] + +===== sample 012 ===== +[CLS],,,, turn - of - road,,,,,,,,,,.,,.,, to the line -,,,,,,,,,,, to turn to the line,,,,,,, and, to the end, period. [SEP] to 52, turn, the turn - to -,,, - to. turn - in - turn, to the next - turn, the next,,,,, etc.,,,, the beginning,,,.,.,,, 14, 15 -,, 14, 15, 14.. [SEP] + +===== sample 013 ===== +[CLS] the same said. [SEP] in the end,,,,,,,,,,,,,,,,,,,,, of the whole future. [SEP] " i think we know, we will be happy soon, " he said. [SEP] and up the whole,,, the breadbaskets,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP] + +===== sample 014 ===== +[CLS] - 17 - 16, 18 - 16 - 17 - 2 - 16 - 31 - - 6 - 14 - 17 - 14 - 14 - - - - 1 - 72 - 17 - 2, 21, 49 -, 31 -, - - 16 - 31 -,, 11, 731, 13, 31 -, -, 14 - 16 - 14 - - - - - - - - - - - - - - 14 - 16 - 112. - - - - 17 - 16 - 13, 16 - 14 - 48 -. - - - - - - - - - - - - - - - - - [SEP] + +===== sample 015 ===== +[CLS], michigan, michigan, michigan, michigan, michigan, michigan, the district, chicago, michigan, michigan, michigan, illinois,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and on. [SEP] the companys was headquartered in college city, ill. [SEP] 14, 2007. [SEP] in boston, boston, the bostons, the, the the..... [SEP] the huskies set up a 14 - 14 run [SEP] + +===== sample 016 ===== +[CLS] have have time to begin the process of finding a deal. [SEP] the end of the letter refers to a series of a - 52, i. u. s., to the,,,,,, a. c. a., of the,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] " they have,,,,,,,,, [SEP] + +===== sample 017 ===== +[CLS],, chicago, chicago, chicago, etc. [SEP] the usa,,,,,,,,,, the usa, the usa,,,,,,,,,,,,,,,,,, etc. [SEP] but for the,,,,,,,,,,,, have way out of the question. [SEP] in the cities of chicago, chicago, chicago, chicago. [SEP] but it didn ' t matter. [SEP] the have have have, they that they back to - - chicago, boston,,,,,,,, etc. [SEP] and happens, no. [SEP] the [SEP] + +===== sample 018 ===== +[CLS] europe, canada, the u. s., canada to canada and canada. [SEP] a have have have have have here in moscow. [SEP] of course, they don ' t bring in the money to have them the door. [SEP],,, chicago, chicago, chicago,, the district,, chicago,,,,,,, chicago to chicago, chicago to chicago, bhut, chicago, chicago, chicago,.........., chicago, chicago, chicago,,,, chicago, chicago, chicago, chicago, chicago,,,,,, and to chicago. [SEP] [SEP] + +===== sample 019 ===== +[CLS] 81, 89, 89, 89. [SEP] period, 2008 - the company ' s 73, 73, 73,,,,,,,,, 37,,, 37,, 37,,,,, 36,,,, 18 - 37, 23 - 37,, 37, 36, 37, 37, 37, 37, 37,..,.,,,,,, 49, 73, 54,. 5.,. 37, 37, 48, 48, 31, 48,,, 37,,,,,,,,, 31 to 38. 50,... [SEP] + +===== sample 020 ===== +[CLS] - - chicago,,,, c.,,,,,,, district of chicago, chicago, chicago, chicago, cleveland,,,,,,,,,,,,, cleveland, and, and in akron, ohio, and ohio. [SEP] the balance line is in addition to the company ' s,, 50, 49, 49 -,,, 38, 50bp, 52 -, -,,, of, respectively. [SEP] and, in the first game of the season, it ' s a 14 - 14 season that has a 1 - 3 points in the first two minutes. [SEP] [SEP] + +===== sample 021 ===== +[CLS],,,,,,,,,,,,, for all. [SEP] " it doesn ' t really matter to the,,,,,,,,,,,,,,,,,,,,,, etc. [SEP] they have have,, and.. [SEP] i think it is,,,,,,,,,,,,,,,, of the day,,,,,,,,,,,,,,,,,,,, to the end. [SEP] the same of of of of,,,,,,,,,,,, [SEP] + +===== sample 022 ===== +[CLS].. [SEP],,,,,,,,,,,,,,,,,,. [SEP] and, say, the leaders of the world,,,,,,. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP] + +===== sample 023 ===== +[CLS], 48, 52, 48,,,,.,,,,,,, 48,,,,,,,,,,,, 48, and, of the region, and region of the uk and region,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and, etc., in the week,,,,,,, the day of the week, the region, the year, number of,,,,,,,,,,,, [SEP] + +===== sample 024 ===== +[CLS] to make up a meal by putting their heads on a table... [SEP] in the end. [SEP] the house would cost at $ 14, 000. [SEP] the question of unity is for unity, but not is unity, " sadr added. [SEP] the pope is not not way to the house of dreams. [SEP] the one is is in the door. [SEP] as he said, chicago, chicago, chicago, chicago, chicago, chicago, chicago, and chicago. [SEP] for them, the haves and,s and,s,ss, and and and ands and for have thes in the field. [SEP] [SEP] + +===== sample 025 ===== +[CLS] what a person can do. [SEP] of words, they never know it, no,,s, etc., oy, drugs, rest,,y,,, to say,,, no,,, a little bit. [SEP] ( by aboutt communications technologies, inc. [SEP] the bulls is have the,,s,,,,s, but there are no moreys in the uy..... [SEP] and the one,ing,sss in the corner... [SEP] the curious - -,,,,, y, pre,,,,s - - all [SEP] + +===== sample 026 ===== +[CLS] 14 - 14 - 14 - 14 - 1. 16 -yyyy -y - 14err 1. 16 -y - 14. [SEP] by -eryyyyyy - 14 % &yyyyyy - 16 % traily - o - 16y - ey - eh - 16yy -yyyyyyyyyyyy - - oyyyyyyyyn - 14yyyyyyyy - 14yyyyyyyyyyyyyyyyyyy [SEP] + +===== sample 027 ===== +[CLS] - - - - - - - - - - - - - - - - - - - - - - - - - - - - - to - date. - - - - - - - - - - - - - - - - - - - - - - - - - period of - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - [SEP] + +===== sample 028 ===== +[CLS]77 - 6077777, 7677117, 76771, 7651777111, 76317877 - 49731, 7677777,734, 767726, number771171 - 0777220792., 49777, 7671, 49 - 49 - 49, 49 - 49 - 49 - 49 - 37 -,7 - 49 - 49 - 49, 7371, 49 - 37 - 49 - 49 - 547 - 48 - 48 - 49 [SEP] + +===== sample 029 ===== +[CLS] detroit, detroit, detroit, the knicks, detroit, detroit, detroit, detroit, chicago were the best teams of the day. [SEP] the list comes in the names of the chicago, detroit, chicago, boston,, chicago, chicago, and and the others. [SEP] but the list is chicago, chicago, chicago, chicago, chicago, chicago, illinois, said david chesney, a political commentator. [SEP] the date for the hearing is set for jan. [SEP] jacobs returned to the jets last season with two injuries. [SEP] when a full - was was springing to the wall at the end of chicago, the chicago was [SEP] + +===== sample 030 ===== +[CLS] the game. [SEP] he will have a good time in the senate. [SEP] results in the later parts of the year, boston, period, 2008. end - to - end,, 21 and 37,,,,,, s. a., 18 - 14, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago and chicago, chicago, region, boston, chicago, st. chicago, michigan, chicago, chicago, the district,,,,,, and on the continent,. - - chicago, chicago, chicago, chicago, a.,,, etc. [SEP] the [SEP] + +===== sample 031 ===== +[CLS]................. [SEP] ( :101.y ( ( ( ( ( ( 7, 500 ). [SEP] 2479. 1......................... [SEP] by. oh, 247....................................................... [SEP] + +===== sample 032 ===== +[CLS],, period, 50, etc. [SEP] indiana,,,, 50,,, - region, region, region,, 37,,, 50, 89. [SEP] chicago, ohio, chicago, chicago, illinois, illinois,,,,,,,,, $ 1, 000, 000. [SEP] region, region, region, region, region, multi - area, region, region, region,,, area, chicago, region, chicago, region, area, area, region,, area, region, region,, region, region,, region, region, region, region - region, region, [SEP] + +===== sample 033 ===== +[CLS]s, o,,,,,,,,,,,s. [SEP] the concept is that the,,,,,,,,,,,,,,,,,, mt. [SEP] the,,,,,,,,,,,,,,,,,,,, is effortless. [SEP] the bulls,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] the,,,,,,,,,,,,,, [SEP] + +===== sample 034 ===== +[CLS],,,,,,,,,,,,,,,,,,. [SEP] and all they wanted to stand out the door on the day, day, day, the end of the day.,,,,,, to,,,,,,, - - and perhaps in the day of days. [SEP] the industry ' s leading companies are private and and construction workers in the united states, michigan, michigan, chicago, michigan, michigan, michigan, michigan, north carolina, ohio, illinois, ireland. [SEP] gates is also dedicated to explaining how the situation was changed in the early soviets. [SEP] [SEP] + +===== sample 035 ===== +[CLS] % to 509 points. [SEP] 3 - 14 - - - - - - -, - 11 - 24 - 11 -, j. 14 - 14 - 16 - 14 - 14. to mid - table 14. 5 - 11, 16 - 14.. 12 - 14 - 14 - 14. - - 14, 16, 16, 16 -,... [SEP] ( ap ) cnn ' s doug klein, greg barrett and jan karsak contributed to this report. [SEP] instead, they went back to the house, with a partition back on the road. [SEP] the 20 - year - old, a 14 - [SEP] + +===== sample 036 ===== +[CLS],, 49,,,,,, 70, 73,,, 73, 73, 73, 73, 89,, 73, 73, 70, 70,,,,, w.,, 89, 89,, 70, 73, 73, 50, 73, 54, 73, 57, y,... of the period,,,,,,,,,,,,,,,,,, and, of the entire of group. [SEP] east city, chicago, chicago, oct. [SEP] for a total of 1, 50,,,,,, 37, 37,, [SEP] + +===== sample 037 ===== +[CLS], 112 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -, 17 - 14 - - - - - 14 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - less than 60 % - - - - - - - - - - - - - - [SEP] + +===== sample 038 ===== +[CLS]... [SEP] number of students,,, 13, 20098, and - 112. - - 14, 2009 - - - - - - - - - - - - - - - for a three - game series. - - - - ticker - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - i ' m - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - [SEP] + +===== sample 039 ===== +[CLS],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and,,,,,,,,,,,,,,,,,, and of the,,,,. [SEP] the me,,,,,,.,,,, a,,,,,,,,,,,,,,,,,,,,,,,, etc. [SEP] the of are s [SEP] + +===== sample 040 ===== +[CLS] there are still a number of questions about the payout of british employees. [SEP] " the meeting happened in the middle of the day, at the the hour.... later in the day, " the paper said. [SEP] the....................... [SEP] a byy,,,,,, chicago,,,,fl,,,,y,usa,,,her, bisty,st,y,,,, to guide,,.,,,,utions, and,,,, [SEP] + +===== sample 041 ===== +[CLS] 2 0. s 1, n7, 1, n.......... 2, n..... 247. 2 n dice to.... 2.1, n.11.11 to.. [SEP] n..7... dice1, s. n...s in n.............. 2171, 247................................ [SEP] + +===== sample 042 ===== +[CLS] the road, a,,,,,,,,,, access to the road. [SEP] thes, boston, detroit, chicago, chicago, chicago,, chicago, chicago,, detroit, chicago, chicago. [SEP] cleveland, chicago 11, 15 - 15 chicago, 11 - chicago, 13 - 14, detroit, n. a. 14, detroit 11, detroit 11, 13 - 14, n., 11, 11 - 14, 11 - 13,... [SEP] [SEP] schools were closed in some areas. [SEP] " of course, no, " the hotel manager told us. [SEP] the company, which [SEP] + +===== sample 043 ===== +[CLS] games. [SEP] the company includes in michigan, michigan, michigan of illinois, illinois, illinois, illinois, michigan,,,,,,,,,,,,, michigan, ohio, illinois, michigan, ohio, and. [SEP] the number of the economy by growth was 0. 4 % in the same quarter in the third quarter of 2008. [SEP] lansing, mich. - - in the middle of the day, down the road, you have to be able to do a good job, even if the road will be worse. [SEP] police say the man was was a, and, and - in road with the [SEP] + +===== sample 044 ===== +[CLS] - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -. - - - - 31 - 31, 37,, 31, 37, and other - - - - - - - - 31 - 14 - - - - - - 31 - 31, 31 - -, 31 -, - - -, -, - - - -, 73 - 37, 31 - 31, 73 - 31 in december 2007, 08 to end 2009, total of $ 582 million ( 2007 to - 08 ) to 1128 in the coming [SEP] + +===== sample 045 ===== +[CLS] the red region. [SEP] there have been heavy showers at several venues in the past two years. [SEP] the car is right in place, and on the back of the road, at the end of the road. [SEP] mr brown said it would have said that the number of jobs and jobs in the uk was to be increased. [SEP] for a " collapse " of the economy. [SEP] the firm is more by, 500 employees with offices in onsite chicago, chicago,, chicago,, chicago, chicago,, chicago, new york, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, [SEP] + +===== sample 046 ===== +[CLS],,,,,,,,,,,,,,,,,,,, in the middle,,,,,,,,,,,,,,,,,,, and,. [SEP] in fact, the american team the most should have in vancouver - - the first trip to the top of the table. [SEP] the game resulted in a combination of chicago, chicago,,,,, and,,,,, and then, according to the detroit - boston game, a 49 - point thriller by the two teams,,, chicago, that has lasted more than 100 minutes. [SEP] [SEP] + +===== sample 047 ===== +[CLS],,,,, 14,,. [SEP],,, michigan, michigan,,, illinois,,,,,,,,,,,,,,,,,,,,, illinois,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] the panel, taking on members of the uk, uk, france, canada,,, france, most of the uk,,,,,,,,,,,,,,,,,,,,, and,,,,, [SEP] + +===== sample 048 ===== +[CLS], period, days, but not days, period, period, to period,, period, period, to period and period at the cost of a week,, period, period, period to, period, period,,,,, period, the same, period, period, period, and,, to period, period to period.. period, period, period, period, period, and a week at the same period, period, period, 30 days at the end, period, days, period, period,, days to each of, and days, 30 days, beginning with,,, beginning, the [SEP] + +===== sample 049 ===== +[CLS], s, s,, s, s, s. [SEP] s, s, s, s, s,, s, s in d, s, s, s, s, s, s, s s, s, s, s, s, in and d. [SEP] s, s, s s, s s, s, s, s, s, s, s, s,, s,,, s, s, s, s, s. [SEP] d,, s, s, s,, s, s, s, s,, and.. [SEP] s, s, s [SEP] + +===== sample 050 ===== +[CLS], -.... 51, 53,,,,.... [SEP],, 50, 50, 50,,,,,,,,, and,,,,,,,,,,,,,,,,, the non - and, of the year -,,,,,,,,,,,. [SEP] in the name of, -,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, -,,,,,,, the kind [SEP] + +===== sample 051 ===== +[CLS].. we are a, -,,,,,,,,,,,...,,,,,,,,,,,,,,,,, w.,.,,,,,,,,,,,,,,,,,,,,,,, and,.,, calculates,,,,,,,,,,,,,,,,,,,,.,,,,.... the e - u has a range of,,,,,,,,,,,.,,,,, [SEP] + +===== sample 052 ===== +[CLS] - - all in the final game of the season - - were confronted by someone in their car. [SEP] he told the rest of the group to get up to the back of the building, and a a and and out into the road. [SEP] " they will have have a way, he is going to give us a lesson. " [SEP] a a a a... [SEP] the number would be $ 1, 000 by the end of the year, and a the, and and and andy of the sames. [SEP] on the point in the area, there are no people in the area, he said. [SEP] the [SEP] + +===== sample 053 ===== +[CLS], 37,,,,,, 21, 26, 26, 37,,,.,,,,,,, 2007. [SEP] for the period - 21, 26, 21, 31, 37, 31, chicago - -,, 26,,, 36,,,,,, 51, 48, 37,, 21, 37, 37, 37,, 37, 37,, 16,,, 14 - 16, 23,,, 14 - 16, 37, 48, 37,, 16 - 16, 16 - 14. -, 14,,,, 17, 37, 37, [SEP] + +===== sample 054 ===== +[CLS] ' s,,,,........,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and,. [SEP] for that words, the likes of the oregon, chicago, illinois, illinois,,,,, are in the most back - to - back,,,, way. [SEP] the [SEP] + +===== sample 055 ===== +[CLS] out of the road, and a and and and have - the widening. [SEP] a few thing was out for nothing. [SEP] ( ap ) - china ' s economic would systems have a significant part of the world, in the north, and the rest of the world, according to the report. [SEP] in fact, the number of for for was of wass, [CLS] 14, 24,,, 2006 ). [SEP] the league ' s rookie all - star isn ' t the only one who seems to be on the court. [SEP] the company is expected to be 1, 000 jobs, and,,y said. [SEP] the [SEP] + +===== sample 056 ===== +[CLS] in and,, and and and and ). [SEP] dr. michigan, michigan, michigan, michigan, s.,., michigan, michigan, michigan, michigan, ohio, etc. [SEP] but, by the end of the year, the number will be to than 1 %. [SEP] by the time he was be out of the political again. [SEP] i ' m not sure, but, have,,,,,,,,ical allss in the us, canada, texas and texas. [SEP]......,.,. and............ [SEP] + +===== sample 057 ===== +[CLS], period, time to time. week of december 1. period to. days in a number of days, week to days in a, period, period, period, period, period,, period. [SEP] it is period, period, period of the period, period, period. period, period, and period. week, period, period, period, period, period, period, period days, change of days, period, week of the same period, week. week, period, period, period, period,, day, period, period, period,. period,, period, period, in a, period [SEP] + +===== sample 058 ===== +[CLS] [SEP] the company continues to have a full year, year, year, year, and return to a full schedule. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP] + +===== sample 059 ===== +[CLS] addition, the rubber coat, comes with unique decorative flavors, such as the rubber coat and the purple mask. [SEP] he became more worried about any future, he said. [SEP] houston ' s loss to detroit in the final game of a series of road - game series. [SEP] i do want to leave the room for a long conversation. [SEP] once again, he knows how to do his job. [SEP] the answer will be limited to,,,,,,, at least. [SEP] they have the bottom end of the road,,,,,,,,,,,,,,,,,,,,, [SEP] + +===== sample 060 ===== +[CLS],,,,, period -,,,,,,,,,,,, and, end of the period, period,,,,,, period to period, period, and, period, period, period, period - period. the date,,,,,,,,,,, and, has the ability to track,,,, period, period, place, start to the year,,,,,,,,, and number of period. [SEP] in the end, the back - up eliminates the illusion of the in the end of the original structure. [SEP] he would have [SEP] + +===== sample 061 ===== +[CLS], chicago, chicago, chicago, end of the day, chicago,, chicago, chicago, chicago,,,,,, chicago, chicago,,,,, chicago, chicago,,, 37, 37, 36, week and the correspondingly beautiful days. [SEP] the third day of the day was marked by the remarkable talents of joe cowen. [SEP] for today, the week has moved from days,, days, days, to december,,, and december. [SEP] 21, 2007,, 2007, and the last 14 days of the year., 31,,,,,,, december, 2007. [SEP] + +===== sample 062 ===== +[CLS], will have been advised to take pre - trip flights due to non - cancellations. [SEP] multi - region, mid -,, day of north -, eastern, east - atlantic, east - atlantic, south -,,, mid -,, mid - atlantic, chicago, chicago, chicago, and chicago,,, western, chicago, and chicago, chicago, chicago, chicago, and,, chicago,,,,,, and chicago, north - to - north, u. s. 78, eastern, eastern, eastern,, and eastern, mid - atlantic, chicago,,,,, and. [SEP] + +===== sample 063 ===== +[CLS] have have have, in the confluence of the celtics and the pistons, and have the best is to the thes in the basket. [SEP] the a -yy, with ofs, and the, and the out of the sand and and, of a single basis. [SEP] the following included, atlanta, atlanta, chicago, chicago, boston, chicago, chicago, chicago, chicago, new york, chicago, etc. [SEP] chicago,, chicago, chicago, chicago, to,ca, 2004 - h2.... [SEP] the idea is is have, have and, with a few, and and and and. [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/state_c1024_t1p45_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/state_c1024_t1p45_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..58d4e4112abbaca950028a0c24ee2d81ab785cb3 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/state_c1024_t1p45_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "state_c1024_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c1024_t1p45", "steps": 16, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 24.348744185198743, "nll_per_token": 3.1924802746955083, "tokens": 7297}, "diversity": {"sample_entropy": 2.0679188483539344, "unique_tokens": 615, "token_count": 8192, "distinct_1": 0.0750732421875, "distinct_2": 0.23363681102362205, "top_token_mass": 0.392578125}} +{"type": "sample", "index": 0, "raw_text": "[CLS], chicago, chicago, chicago, and,, we get a list - chicago,,, chicago,,,,, chicago, chicago, michigan, chicago,, and more. [SEP] goal of. thomas 14 - 0. 7. - 13, inc. - - michigan, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago,,, chicago,,,,,,,, illinois,, chicago, illinois, chicago, university of michigan, ohio. michigan, michigan, ohio,, michigan, michigan, ohio, ohio,, ohio, ohio, michigan, and [SEP]", "detok_text": "[CLS], chicago, chicago, chicago, and,, we get a list - chicago,,, chicago,,,,, chicago, chicago, michigan, chicago,, and more. [SEP] goal of. thomas 14 - 0. 7. - 13, inc. - - michigan, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago,,, chicago,,,,,,,, illinois,, chicago, illinois, chicago, university of michigan, ohio. michigan, michigan, ohio,, michigan, michigan, ohio, ohio,, ohio, ohio, michigan, and [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS],,,,,, 50, 50, 48,,, 50,,,, 51,,,,,,,, etc. [SEP] the list is 50,,,,,,,,, etc. [SEP] 14,,, 13, 15, 17, 15, 17, 15, 17,, 15, 17, 16, 16,, 13, 14, 14.,, 14, 13, 14, 14 -,,,,,, 26, 37, 37, the other end of the road, 37, 37, 37,,,, 37,,, 37,, [SEP]", "detok_text": "[CLS],,,,,, 50, 50, 48,,, 50,,,, 51,,,,,,,, etc. [SEP] the list is 50,,,,,,,,, etc. [SEP] 14,,, 13, 15, 17, 15, 17, 15, 17,, 15, 17, 16, 16,, 13, 14, 14.,, 14, 13, 14, 14 -,,,,,, 26, 37, 37, the other end of the road, 37, 37, 37,,,, 37,,, 37,, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS], 2004, 2005,,,,,,, 2006 and 31, and, respectively. [SEP] scutton has 1. 6,,,,,,,, and 2. 5, 7, 14,,,,,,,,,,,,,, 4, etc. [SEP] the firm includes in chicago, chicago,,, % in the region, 50 %, and 50 % in the conference, chicago, chicago, chicago, chicago, chicago, chicago,,, chicago. [SEP] the state - run company already already has more than $ 40bn in debt assets. [SEP] the collapse in confidence [SEP]", "detok_text": "[CLS], 2004, 2005,,,,,,, 2006 and 31, and, respectively. [SEP] scutton has 1. 6,,,,,,,, and 2. 5, 7, 14,,,,,,,,,,,,,, 4, etc. [SEP] the firm includes in chicago, chicago,,, % in the region, 50 %, and 50 % in the conference, chicago, chicago, chicago, chicago, chicago, chicago,,, chicago. [SEP] the state - run company already already has more than $40bn in debt assets. [SEP] the collapse in confidence [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS] of the country,,,,,,,,,,,,,, country,,,, the city, state, city, city,, city, and region. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, in the,,,,,,,,, and,,,,,,,,,,. [SEP] in and of - - ohio, illinois, illinois, illinois,,,, illinois, illinois, illinois, illinois,,,,,,,,, [SEP]", "detok_text": "[CLS] of the country,,,,,,,,,,,,,, country,,,, the city, state, city, city,, city, and region. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, in the,,,,,,,,, and,,,,,,,,,,. [SEP] in and of - - ohio, illinois, illinois, illinois,,,, illinois, illinois, illinois, illinois,,,,,,,,, [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] the moment of 1893, just over 500 square feet of the piece, the plane was a a point - down on the side of the fuselage. [SEP] he said he was taught the concept of the idea that people would have have to what what not not have have together. [SEP] thec originates, develops and has offices in chicago, chicago, new york, chicago, mid - chicago,, york, chicago, chicago, chicago, and in the us, uk,,,, and, and. [SEP] in chicago, detroit, the penguins, bulls and the white, in chicago, the power have the only -,, of [SEP]", "detok_text": "[CLS] the moment of 1893, just over 500 square feet of the piece, the plane was a a point - down on the side of the fuselage. [SEP] he said he was taught the concept of the idea that people would have have to what what not not have have together. [SEP] thec originates, develops and has offices in chicago, chicago, new york, chicago, mid - chicago,, york, chicago, chicago, chicago, and in the us, uk,,,, and, and. [SEP] in chicago, detroit, the penguins, bulls and the white, in chicago, the power have the only -,, of [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS]. s. raleigh, n. d., thousands of the players have,,, - - chicago, chicago, chicago, chicago,,,,,,,,,,, have have [CLS] in the end of the season to send him back to the basket in the the playoffs. [SEP] the them with the butter in place. [SEP] the man is is right in the back, - in the back and, of course, in the back of the time - - - and, in fact, he is about to sign to a new world record. [SEP] the answer was have about the beijing. [SEP] the rest of the [SEP]", "detok_text": "[CLS]. s. raleigh, n. d., thousands of the players have,,, - - chicago, chicago, chicago, chicago,,,,,,,,,,, have have [CLS] in the end of the season to send him back to the basket in the the playoffs. [SEP] the them with the butter in place. [SEP] the man is is right in the back, - in the back and, of course, in the back of the time - - - and, in fact, he is about to sign to a new world record. [SEP] the answer was have about the beijing. [SEP] the rest of the [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and, in the rest of the day,,,,, and,. \" [SEP] the winner, the,,, has the time, time and place to stand in the,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP], -,,,,,,,,,,,, of,. [SEP] a few chunk of thes between the clock and the.. [SEP]", "detok_text": "[CLS],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and, in the rest of the day,,,,, and,. \" [SEP] the winner, the,,, has the time, time and place to stand in the,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP], -,,,,,,,,,,,, of,. [SEP] a few chunk of thes between the clock and the.. [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS]1. 9 - - - - - - - - - - - - - - - - - - - - - - - - - - - 14. - - - - - - - - - - pb11. - - - - - - - - - - - - - - - - - 14, 2009, - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - [SEP]", "detok_text": "[CLS]1. 9 - - - - - - - - - - - - - - - - - - - - - - - - - - - 14. - - - - - - - - - - pb11. - - - - - - - - - - - - - - - - - 14, 2009, - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] to shove her in the face. [SEP] the,,,,, the linens,,, the planes, the wagons, the planes, according to the chicago,,,,,,. [SEP],,,,,,,,,,,,,,,,,,,,,,,. [SEP] two - thirds of the fans will have to get on the road to win the championship game. [SEP] i mean, to,, to,,,,, the road,,,,,, the country,,,,,,,, and give you the name, \" he said. [SEP]", "detok_text": "[CLS] to shove her in the face. [SEP] the,,,,, the linens,,, the planes, the wagons, the planes, according to the chicago,,,,,,. [SEP],,,,,,,,,,,,,,,,,,,,,,,. [SEP] two - thirds of the fans will have to get on the road to win the championship game. [SEP] i mean, to,, to,,,,, the road,,,,,, the country,,,,,,,, and give you the name, \" he said. [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS],,,,,,,,,,,,,,,,, end of the day.,,,,, in,,,,,,,,,,,,,,,,. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] we have have have have,, have have have have for.. [SEP] the rockets, as if they were an awful team [SEP]", "detok_text": "[CLS],,,,,,,,,,,,,,,,, end of the day.,,,,, in,,,,,,,,,,,,,,,,. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] we have have have have,, have have have have for.. [SEP] the rockets, as if they were an awful team [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 74, 17 - 14 - 14 - - - - - - - - - - - - - - - - - - - - - - - - - - -, 73 - - - - - - -1, 112 -, - 31, 68 - 14, 68 - 14 to the end - - - - - - - - - - - - - - - - - - - - - - - - [SEP]", "detok_text": "[CLS] - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - 74, 17 - 14 - 14 - - - - - - - - - - - - - - - - - - - - - - - - - - -, 73 - - - - - - -1, 112 -, - 31, 68 - 14, 68 - 14 to the end - - - - - - - - - - - - - - - - - - - - - - - - [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS], 37,,,, 37, 37, 37, 37, 37,,, 37, 37,,,,,,,,,,,,,,,,,,,,,,,,,, and back - to - back in the period of december 31, 2008 are,,,,, 36 -,....,, three weeks to date, to end the week,,,,,,,,,,,,,, 37, 37, days in the week of week -,,,,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS], 37,,,, 37, 37, 37, 37, 37,,, 37, 37,,,,,,,,,,,,,,,,,,,,,,,,,, and back - to - back in the period of december 31, 2008 are,,,,, 36 -,....,, three weeks to date, to end the week,,,,,,,,,,,,,, 37, 37, days in the week of week -,,,,,,,,,,,,,,,, [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS],,,, turn - of - road,,,,,,,,,,.,,.,, to the line -,,,,,,,,,,, to turn to the line,,,,,,, and, to the end, period. [SEP] to 52, turn, the turn - to -,,, - to. turn - in - turn, to the next - turn, the next,,,,, etc.,,,, the beginning,,,.,.,,, 14, 15 -,, 14, 15, 14.. [SEP]", "detok_text": "[CLS],,,, turn - of - road,,,,,,,,,,.,,.,, to the line -,,,,,,,,,,, to turn to the line,,,,,,, and, to the end, period. [SEP] to 52, turn, the turn - to -,,, - to. turn - in - turn, to the next - turn, the next,,,,, etc.,,,, the beginning,,,.,.,,, 14, 15 -,, 14, 15, 14.. [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS] the same said. [SEP] in the end,,,,,,,,,,,,,,,,,,,,, of the whole future. [SEP] \" i think we know, we will be happy soon, \" he said. [SEP] and up the whole,,, the breadbaskets,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS] the same said. [SEP] in the end,,,,,,,,,,,,,,,,,,,,, of the whole future. [SEP] \"i think we know, we will be happy soon,\" he said. [SEP] and up the whole,,, the breadbaskets,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] - 17 - 16, 18 - 16 - 17 - 2 - 16 - 31 - - 6 - 14 - 17 - 14 - 14 - - - - 1 - 72 - 17 - 2, 21, 49 -, 31 -, - - 16 - 31 -,, 11, 731, 13, 31 -, -, 14 - 16 - 14 - - - - - - - - - - - - - - 14 - 16 - 112. - - - - 17 - 16 - 13, 16 - 14 - 48 -. - - - - - - - - - - - - - - - - - [SEP]", "detok_text": "[CLS] - 17 - 16, 18 - 16 - 17 - 2 - 16 - 31 - - 6 - 14 - 17 - 14 - 14 - - - - 1 - 72 - 17 - 2, 21, 49 -, 31 -, - - 16 - 31 -,, 11, 731, 13, 31 -, -, 14 - 16 - 14 - - - - - - - - - - - - - - 14 - 16 - 112. - - - - 17 - 16 - 13, 16 - 14 - 48 -. - - - - - - - - - - - - - - - - - [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS], michigan, michigan, michigan, michigan, michigan, michigan, the district, chicago, michigan, michigan, michigan, illinois,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and on. [SEP] the companys was headquartered in college city, ill. [SEP] 14, 2007. [SEP] in boston, boston, the bostons, the, the the..... [SEP] the huskies set up a 14 - 14 run [SEP]", "detok_text": "[CLS], michigan, michigan, michigan, michigan, michigan, michigan, the district, chicago, michigan, michigan, michigan, illinois,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and on. [SEP] the companys was headquartered in college city, ill. [SEP] 14, 2007. [SEP] in boston, boston, the bostons, the, the the..... [SEP] the huskies set up a 14 - 14 run [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] have have time to begin the process of finding a deal. [SEP] the end of the letter refers to a series of a - 52, i. u. s., to the,,,,,, a. c. a., of the,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] \" they have,,,,,,,,, [SEP]", "detok_text": "[CLS] have have time to begin the process of finding a deal. [SEP] the end of the letter refers to a series of a - 52, i. u. s., to the,,,,,, a. c. a., of the,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] \" they have,,,,,,,,, [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS],, chicago, chicago, chicago, etc. [SEP] the usa,,,,,,,,,, the usa, the usa,,,,,,,,,,,,,,,,,, etc. [SEP] but for the,,,,,,,,,,,, have way out of the question. [SEP] in the cities of chicago, chicago, chicago, chicago. [SEP] but it didn ' t matter. [SEP] the have have have, they that they back to - - chicago, boston,,,,,,,, etc. [SEP] and happens, no. [SEP] the [SEP]", "detok_text": "[CLS],, chicago, chicago, chicago, etc. [SEP] the usa,,,,,,,,,, the usa, the usa,,,,,,,,,,,,,,,,,, etc. [SEP] but for the,,,,,,,,,,,, have way out of the question. [SEP] in the cities of chicago, chicago, chicago, chicago. [SEP] but it didn't matter. [SEP] the have have have, they that they back to - - chicago, boston,,,,,,,, etc. [SEP] and happens, no. [SEP] the [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS] europe, canada, the u. s., canada to canada and canada. [SEP] a have have have have have here in moscow. [SEP] of course, they don ' t bring in the money to have them the door. [SEP],,, chicago, chicago, chicago,, the district,, chicago,,,,,,, chicago to chicago, chicago to chicago, bhut, chicago, chicago, chicago,.........., chicago, chicago, chicago,,,, chicago, chicago, chicago, chicago, chicago,,,,,, and to chicago. [SEP] [SEP]", "detok_text": "[CLS] europe, canada, the u. s., canada to canada and canada. [SEP] a have have have have have here in moscow. [SEP] of course, they don't bring in the money to have them the door. [SEP],,, chicago, chicago, chicago,, the district,, chicago,,,,,,, chicago to chicago, chicago to chicago, bhut, chicago, chicago, chicago,.........., chicago, chicago, chicago,,,, chicago, chicago, chicago, chicago, chicago,,,,,, and to chicago. [SEP] [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] 81, 89, 89, 89. [SEP] period, 2008 - the company ' s 73, 73, 73,,,,,,,,, 37,,, 37,, 37,,,,, 36,,,, 18 - 37, 23 - 37,, 37, 36, 37, 37, 37, 37, 37,..,.,,,,,, 49, 73, 54,. 5.,. 37, 37, 48, 48, 31, 48,,, 37,,,,,,,,, 31 to 38. 50,... [SEP]", "detok_text": "[CLS] 81, 89, 89, 89. [SEP] period, 2008 - the company's 73, 73, 73,,,,,,,,, 37,,, 37,, 37,,,,, 36,,,, 18 - 37, 23 - 37,, 37, 36, 37, 37, 37, 37, 37,..,.,,,,,, 49, 73, 54,. 5.,. 37, 37, 48, 48, 31, 48,,, 37,,,,,,,,, 31 to 38. 50,... [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] - - chicago,,,, c.,,,,,,, district of chicago, chicago, chicago, chicago, cleveland,,,,,,,,,,,,, cleveland, and, and in akron, ohio, and ohio. [SEP] the balance line is in addition to the company ' s,, 50, 49, 49 -,,, 38, 50bp, 52 -, -,,, of, respectively. [SEP] and, in the first game of the season, it ' s a 14 - 14 season that has a 1 - 3 points in the first two minutes. [SEP] [SEP]", "detok_text": "[CLS] - - chicago,,,, c.,,,,,,, district of chicago, chicago, chicago, chicago, cleveland,,,,,,,,,,,,, cleveland, and, and in akron, ohio, and ohio. [SEP] the balance line is in addition to the company's,, 50, 49, 49 -,,, 38, 50bp, 52 -, -,,, of, respectively. [SEP] and, in the first game of the season, it's a 14 - 14 season that has a 1 - 3 points in the first two minutes. [SEP] [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS],,,,,,,,,,,,, for all. [SEP] \" it doesn ' t really matter to the,,,,,,,,,,,,,,,,,,,,,, etc. [SEP] they have have,, and.. [SEP] i think it is,,,,,,,,,,,,,,,, of the day,,,,,,,,,,,,,,,,,,,, to the end. [SEP] the same of of of of,,,,,,,,,,,, [SEP]", "detok_text": "[CLS],,,,,,,,,,,,, for all. [SEP] \" it doesn't really matter to the,,,,,,,,,,,,,,,,,,,,,, etc. [SEP] they have have,, and.. [SEP] i think it is,,,,,,,,,,,,,,,, of the day,,,,,,,,,,,,,,,,,,,, to the end. [SEP] the same of of of of,,,,,,,,,,,, [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS].. [SEP],,,,,,,,,,,,,,,,,,. [SEP] and, say, the leaders of the world,,,,,,. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS].. [SEP],,,,,,,,,,,,,,,,,,. [SEP] and, say, the leaders of the world,,,,,,. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS], 48, 52, 48,,,,.,,,,,,, 48,,,,,,,,,,,, 48, and, of the region, and region of the uk and region,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and, etc., in the week,,,,,,, the day of the week, the region, the year, number of,,,,,,,,,,,, [SEP]", "detok_text": "[CLS], 48, 52, 48,,,,.,,,,,,, 48,,,,,,,,,,,, 48, and, of the region, and region of the uk and region,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and, etc., in the week,,,,,,, the day of the week, the region, the year, number of,,,,,,,,,,,, [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] to make up a meal by putting their heads on a table... [SEP] in the end. [SEP] the house would cost at $ 14, 000. [SEP] the question of unity is for unity, but not is unity, \" sadr added. [SEP] the pope is not not way to the house of dreams. [SEP] the one is is in the door. [SEP] as he said, chicago, chicago, chicago, chicago, chicago, chicago, chicago, and chicago. [SEP] for them, the haves and,s and,s,ss, and and and ands and for have thes in the field. [SEP] [SEP]", "detok_text": "[CLS] to make up a meal by putting their heads on a table... [SEP] in the end. [SEP] the house would cost at $14, 000. [SEP] the question of unity is for unity, but not is unity, \" sadr added. [SEP] the pope is not not way to the house of dreams. [SEP] the one is is in the door. [SEP] as he said, chicago, chicago, chicago, chicago, chicago, chicago, chicago, and chicago. [SEP] for them, the haves and,s and,s,ss, and and and ands and for have thes in the field. [SEP] [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] what a person can do. [SEP] of words, they never know it, no,,s, etc., oy, drugs, rest,,y,,, to say,,, no,,, a little bit. [SEP] ( by aboutt communications technologies, inc. [SEP] the bulls is have the,,s,,,,s, but there are no moreys in the uy..... [SEP] and the one,ing,sss in the corner... [SEP] the curious - -,,,,, y, pre,,,,s - - all [SEP]", "detok_text": "[CLS] what a person can do. [SEP] of words, they never know it, no,,s, etc., oy, drugs, rest,,y,,, to say,,, no,,, a little bit. [SEP] ( by aboutt communications technologies, inc. [SEP] the bulls is have the,,s,,,,s, but there are no moreys in the uy..... [SEP] and the one,ing,sss in the corner... [SEP] the curious - -,,,,, y, pre,,,,s - - all [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] 14 - 14 - 14 - 14 - 1. 16 -yyyy -y - 14err 1. 16 -y - 14. [SEP] by -eryyyyyy - 14 % &yyyyyy - 16 % traily - o - 16y - ey - eh - 16yy -yyyyyyyyyyyy - - oyyyyyyyyn - 14yyyyyyyy - 14yyyyyyyyyyyyyyyyyyy [SEP]", "detok_text": "[CLS] 14 - 14 - 14 - 14 - 1. 16 -yyyy -y - 14err 1. 16 -y - 14. [SEP] by -eryyyyyy - 14 % &yyyyyy - 16 % traily - o - 16y - ey - eh - 16yy -yyyyyyyyyyyy - - oyyyyyyyyn - 14yyyyyyyy - 14yyyyyyyyyyyyyyyyyyy [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS] - - - - - - - - - - - - - - - - - - - - - - - - - - - - - to - date. - - - - - - - - - - - - - - - - - - - - - - - - - period of - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - [SEP]", "detok_text": "[CLS] - - - - - - - - - - - - - - - - - - - - - - - - - - - - - to - date. - - - - - - - - - - - - - - - - - - - - - - - - - period of - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS]77 - 6077777, 7677117, 76771, 7651777111, 76317877 - 49731, 7677777,734, 767726, number771171 - 0777220792., 49777, 7671, 49 - 49 - 49, 49 - 49 - 49 - 49 - 37 -,7 - 49 - 49 - 49, 7371, 49 - 37 - 49 - 49 - 547 - 48 - 48 - 49 [SEP]", "detok_text": "[CLS]77 - 6077777, 7677117, 76771, 7651777111, 76317877 - 49731, 7677777,734, 767726, number771171 - 0777220792., 49777, 7671, 49 - 49 - 49, 49 - 49 - 49 - 49 - 37 -,7 - 49 - 49 - 49, 7371, 49 - 37 - 49 - 49 - 547 - 48 - 48 - 49 [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] detroit, detroit, detroit, the knicks, detroit, detroit, detroit, detroit, chicago were the best teams of the day. [SEP] the list comes in the names of the chicago, detroit, chicago, boston,, chicago, chicago, and and the others. [SEP] but the list is chicago, chicago, chicago, chicago, chicago, chicago, illinois, said david chesney, a political commentator. [SEP] the date for the hearing is set for jan. [SEP] jacobs returned to the jets last season with two injuries. [SEP] when a full - was was springing to the wall at the end of chicago, the chicago was [SEP]", "detok_text": "[CLS] detroit, detroit, detroit, the knicks, detroit, detroit, detroit, detroit, chicago were the best teams of the day. [SEP] the list comes in the names of the chicago, detroit, chicago, boston,, chicago, chicago, and and the others. [SEP] but the list is chicago, chicago, chicago, chicago, chicago, chicago, illinois, said david chesney, a political commentator. [SEP] the date for the hearing is set for jan. [SEP] jacobs returned to the jets last season with two injuries. [SEP] when a full - was was springing to the wall at the end of chicago, the chicago was [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] the game. [SEP] he will have a good time in the senate. [SEP] results in the later parts of the year, boston, period, 2008. end - to - end,, 21 and 37,,,,,, s. a., 18 - 14, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago and chicago, chicago, region, boston, chicago, st. chicago, michigan, chicago, chicago, the district,,,,,, and on the continent,. - - chicago, chicago, chicago, chicago, a.,,, etc. [SEP] the [SEP]", "detok_text": "[CLS] the game. [SEP] he will have a good time in the senate. [SEP] results in the later parts of the year, boston, period, 2008. end - to - end,, 21 and 37,,,,,, s. a., 18 - 14, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago and chicago, chicago, region, boston, chicago, st. chicago, michigan, chicago, chicago, the district,,,,,, and on the continent,. - - chicago, chicago, chicago, chicago, a.,,, etc. [SEP] the [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS]................. [SEP] ( :101.y ( ( ( ( ( ( 7, 500 ). [SEP] 2479. 1......................... [SEP] by. oh, 247....................................................... [SEP]", "detok_text": "[CLS]................. [SEP] ( :101.y ( ( ( ( ( (7, 500). [SEP] 2479. 1......................... [SEP] by. oh, 247....................................................... [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS],, period, 50, etc. [SEP] indiana,,,, 50,,, - region, region, region,, 37,,, 50, 89. [SEP] chicago, ohio, chicago, chicago, illinois, illinois,,,,,,,,, $ 1, 000, 000. [SEP] region, region, region, region, region, multi - area, region, region, region,,, area, chicago, region, chicago, region, area, area, region,, area, region, region,, region, region,, region, region, region, region - region, region, [SEP]", "detok_text": "[CLS],, period, 50, etc. [SEP] indiana,,,, 50,,, - region, region, region,, 37,,, 50, 89. [SEP] chicago, ohio, chicago, chicago, illinois, illinois,,,,,,,,, $1, 000, 000. [SEP] region, region, region, region, region, multi - area, region, region, region,,, area, chicago, region, chicago, region, area, area, region,, area, region, region,, region, region,, region, region, region, region - region, region, [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS]s, o,,,,,,,,,,,s. [SEP] the concept is that the,,,,,,,,,,,,,,,,,, mt. [SEP] the,,,,,,,,,,,,,,,,,,,, is effortless. [SEP] the bulls,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] the,,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS]s, o,,,,,,,,,,,s. [SEP] the concept is that the,,,,,,,,,,,,,,,,,, mt. [SEP] the,,,,,,,,,,,,,,,,,,,, is effortless. [SEP] the bulls,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] the,,,,,,,,,,,,,, [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS],,,,,,,,,,,,,,,,,,. [SEP] and all they wanted to stand out the door on the day, day, day, the end of the day.,,,,,, to,,,,,,, - - and perhaps in the day of days. [SEP] the industry ' s leading companies are private and and construction workers in the united states, michigan, michigan, chicago, michigan, michigan, michigan, michigan, north carolina, ohio, illinois, ireland. [SEP] gates is also dedicated to explaining how the situation was changed in the early soviets. [SEP] [SEP]", "detok_text": "[CLS],,,,,,,,,,,,,,,,,,. [SEP] and all they wanted to stand out the door on the day, day, day, the end of the day.,,,,,, to,,,,,,, - - and perhaps in the day of days. [SEP] the industry's leading companies are private and and construction workers in the united states, michigan, michigan, chicago, michigan, michigan, michigan, michigan, north carolina, ohio, illinois, ireland. [SEP] gates is also dedicated to explaining how the situation was changed in the early soviets. [SEP] [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS] % to 509 points. [SEP] 3 - 14 - - - - - - -, - 11 - 24 - 11 -, j. 14 - 14 - 16 - 14 - 14. to mid - table 14. 5 - 11, 16 - 14.. 12 - 14 - 14 - 14. - - 14, 16, 16, 16 -,... [SEP] ( ap ) cnn ' s doug klein, greg barrett and jan karsak contributed to this report. [SEP] instead, they went back to the house, with a partition back on the road. [SEP] the 20 - year - old, a 14 - [SEP]", "detok_text": "[CLS] % to 509 points. [SEP] 3 - 14 - - - - - - -, - 11 - 24 - 11 -, j. 14 - 14 - 16 - 14 - 14. to mid - table 14. 5 - 11, 16 - 14.. 12 - 14 - 14 - 14. - - 14, 16, 16, 16 -,... [SEP] (ap) cnn's doug klein, greg barrett and jan karsak contributed to this report. [SEP] instead, they went back to the house, with a partition back on the road. [SEP] the 20 - year - old, a 14 - [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS],, 49,,,,,, 70, 73,,, 73, 73, 73, 73, 89,, 73, 73, 70, 70,,,,, w.,, 89, 89,, 70, 73, 73, 50, 73, 54, 73, 57, y,... of the period,,,,,,,,,,,,,,,,,, and, of the entire of group. [SEP] east city, chicago, chicago, oct. [SEP] for a total of 1, 50,,,,,, 37, 37,, [SEP]", "detok_text": "[CLS],, 49,,,,,, 70, 73,,, 73, 73, 73, 73, 89,, 73, 73, 70, 70,,,,, w.,, 89, 89,, 70, 73, 73, 50, 73, 54, 73, 57, y,... of the period,,,,,,,,,,,,,,,,,, and, of the entire of group. [SEP] east city, chicago, chicago, oct. [SEP] for a total of 1, 50,,,,,, 37, 37,, [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS], 112 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -, 17 - 14 - - - - - 14 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - less than 60 % - - - - - - - - - - - - - - [SEP]", "detok_text": "[CLS], 112 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -, 17 - 14 - - - - - 14 - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - less than 60 % - - - - - - - - - - - - - - [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS]... [SEP] number of students,,, 13, 20098, and - 112. - - 14, 2009 - - - - - - - - - - - - - - - for a three - game series. - - - - ticker - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - i ' m - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - [SEP]", "detok_text": "[CLS]... [SEP] number of students,,, 13, 20098, and - 112. - - 14, 2009 - - - - - - - - - - - - - - - for a three - game series. - - - - ticker - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - i'm - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and,,,,,,,,,,,,,,,,,, and of the,,,,. [SEP] the me,,,,,,.,,,, a,,,,,,,,,,,,,,,,,,,,,,,, etc. [SEP] the of are s [SEP]", "detok_text": "[CLS],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and,,,,,,,,,,,,,,,,,, and of the,,,,. [SEP] the me,,,,,,.,,,, a,,,,,,,,,,,,,,,,,,,,,,,, etc. [SEP] the of are s [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] there are still a number of questions about the payout of british employees. [SEP] \" the meeting happened in the middle of the day, at the the hour.... later in the day, \" the paper said. [SEP] the....................... [SEP] a byy,,,,,, chicago,,,,fl,,,,y,usa,,,her, bisty,st,y,,,, to guide,,.,,,,utions, and,,,, [SEP]", "detok_text": "[CLS] there are still a number of questions about the payout of british employees. [SEP] \"the meeting happened in the middle of the day, at the the hour.... later in the day,\" the paper said. [SEP] the....................... [SEP] a byy,,,,,, chicago,,,,fl,,,,y,usa,,,her, bisty,st,y,,,, to guide,,.,,,,utions, and,,,, [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] 2 0. s 1, n7, 1, n.......... 2, n..... 247. 2 n dice to.... 2.1, n.11.11 to.. [SEP] n..7... dice1, s. n...s in n.............. 2171, 247................................ [SEP]", "detok_text": "[CLS] 2 0. s 1, n7, 1, n.......... 2, n..... 247. 2 n dice to.... 2.1, n.11.11 to.. [SEP] n..7... dice1, s. n...s in n.............. 2171, 247................................ [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] the road, a,,,,,,,,,, access to the road. [SEP] thes, boston, detroit, chicago, chicago, chicago,, chicago, chicago,, detroit, chicago, chicago. [SEP] cleveland, chicago 11, 15 - 15 chicago, 11 - chicago, 13 - 14, detroit, n. a. 14, detroit 11, detroit 11, 13 - 14, n., 11, 11 - 14, 11 - 13,... [SEP] [SEP] schools were closed in some areas. [SEP] \" of course, no, \" the hotel manager told us. [SEP] the company, which [SEP]", "detok_text": "[CLS] the road, a,,,,,,,,,, access to the road. [SEP] thes, boston, detroit, chicago, chicago, chicago,, chicago, chicago,, detroit, chicago, chicago. [SEP] cleveland, chicago 11, 15 - 15 chicago, 11 - chicago, 13 - 14, detroit, n. a. 14, detroit 11, detroit 11, 13 - 14, n., 11, 11 - 14, 11 - 13,... [SEP] [SEP] schools were closed in some areas. [SEP] \"of course, no,\" the hotel manager told us. [SEP] the company, which [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] games. [SEP] the company includes in michigan, michigan, michigan of illinois, illinois, illinois, illinois, michigan,,,,,,,,,,,,, michigan, ohio, illinois, michigan, ohio, and. [SEP] the number of the economy by growth was 0. 4 % in the same quarter in the third quarter of 2008. [SEP] lansing, mich. - - in the middle of the day, down the road, you have to be able to do a good job, even if the road will be worse. [SEP] police say the man was was a, and, and - in road with the [SEP]", "detok_text": "[CLS] games. [SEP] the company includes in michigan, michigan, michigan of illinois, illinois, illinois, illinois, michigan,,,,,,,,,,,,, michigan, ohio, illinois, michigan, ohio, and. [SEP] the number of the economy by growth was 0. 4 % in the same quarter in the third quarter of 2008. [SEP] lansing, mich. - - in the middle of the day, down the road, you have to be able to do a good job, even if the road will be worse. [SEP] police say the man was was a, and, and - in road with the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -. - - - - 31 - 31, 37,, 31, 37, and other - - - - - - - - 31 - 14 - - - - - - 31 - 31, 31 - -, 31 -, - - -, -, - - - -, 73 - 37, 31 - 31, 73 - 31 in december 2007, 08 to end 2009, total of $ 582 million ( 2007 to - 08 ) to 1128 in the coming [SEP]", "detok_text": "[CLS] - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -. - - - - 31 - 31, 37,, 31, 37, and other - - - - - - - - 31 - 14 - - - - - - 31 - 31, 31 - -, 31 -, - - -, -, - - - -, 73 - 37, 31 - 31, 73 - 31 in december 2007, 08 to end 2009, total of $582 million (2007 to - 08) to 1128 in the coming [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] the red region. [SEP] there have been heavy showers at several venues in the past two years. [SEP] the car is right in place, and on the back of the road, at the end of the road. [SEP] mr brown said it would have said that the number of jobs and jobs in the uk was to be increased. [SEP] for a \" collapse \" of the economy. [SEP] the firm is more by, 500 employees with offices in onsite chicago, chicago,, chicago,, chicago, chicago,, chicago, new york, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, [SEP]", "detok_text": "[CLS] the red region. [SEP] there have been heavy showers at several venues in the past two years. [SEP] the car is right in place, and on the back of the road, at the end of the road. [SEP] mr brown said it would have said that the number of jobs and jobs in the uk was to be increased. [SEP] for a \"collapse\" of the economy. [SEP] the firm is more by, 500 employees with offices in onsite chicago, chicago,, chicago,, chicago, chicago,, chicago, new york, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS],,,,,,,,,,,,,,,,,,,, in the middle,,,,,,,,,,,,,,,,,,, and,. [SEP] in fact, the american team the most should have in vancouver - - the first trip to the top of the table. [SEP] the game resulted in a combination of chicago, chicago,,,,, and,,,,, and then, according to the detroit - boston game, a 49 - point thriller by the two teams,,, chicago, that has lasted more than 100 minutes. [SEP] [SEP]", "detok_text": "[CLS],,,,,,,,,,,,,,,,,,,, in the middle,,,,,,,,,,,,,,,,,,, and,. [SEP] in fact, the american team the most should have in vancouver - - the first trip to the top of the table. [SEP] the game resulted in a combination of chicago, chicago,,,,, and,,,,, and then, according to the detroit - boston game, a 49 - point thriller by the two teams,,, chicago, that has lasted more than 100 minutes. [SEP] [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS],,,,, 14,,. [SEP],,, michigan, michigan,,, illinois,,,,,,,,,,,,,,,,,,,,, illinois,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] the panel, taking on members of the uk, uk, france, canada,,, france, most of the uk,,,,,,,,,,,,,,,,,,,,, and,,,,, [SEP]", "detok_text": "[CLS],,,,, 14,,. [SEP],,, michigan, michigan,,, illinois,,,,,,,,,,,,,,,,,,,,, illinois,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,. [SEP] the panel, taking on members of the uk, uk, france, canada,,, france, most of the uk,,,,,,,,,,,,,,,,,,,,, and,,,,, [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS], period, days, but not days, period, period, to period,, period, period, to period and period at the cost of a week,, period, period, period to, period, period,,,,, period, the same, period, period, period, and,, to period, period to period.. period, period, period, period, period, and a week at the same period, period, period, 30 days at the end, period, days, period, period,, days to each of, and days, 30 days, beginning with,,, beginning, the [SEP]", "detok_text": "[CLS], period, days, but not days, period, period, to period,, period, period, to period and period at the cost of a week,, period, period, period to, period, period,,,,, period, the same, period, period, period, and,, to period, period to period.. period, period, period, period, period, and a week at the same period, period, period, 30 days at the end, period, days, period, period,, days to each of, and days, 30 days, beginning with,,, beginning, the [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS], s, s,, s, s, s. [SEP] s, s, s, s, s,, s, s in d, s, s, s, s, s, s, s s, s, s, s, s, in and d. [SEP] s, s, s s, s s, s, s, s, s, s, s, s,, s,,, s, s, s, s, s. [SEP] d,, s, s, s,, s, s, s, s,, and.. [SEP] s, s, s [SEP]", "detok_text": "[CLS], s, s,, s, s, s. [SEP] s, s, s, s, s,, s, s in d, s, s, s, s, s, s, s s, s, s, s, s, in and d. [SEP] s, s, s s, s s, s, s, s, s, s, s, s,, s,,, s, s, s, s, s. [SEP] d,, s, s, s,, s, s, s, s,, and.. [SEP] s, s, s [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS], -.... 51, 53,,,,.... [SEP],, 50, 50, 50,,,,,,,,, and,,,,,,,,,,,,,,,,, the non - and, of the year -,,,,,,,,,,,. [SEP] in the name of, -,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, -,,,,,,, the kind [SEP]", "detok_text": "[CLS], -.... 51, 53,,,,.... [SEP],, 50, 50, 50,,,,,,,,, and,,,,,,,,,,,,,,,,, the non - and, of the year -,,,,,,,,,,,. [SEP] in the name of, -,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, -,,,,,,, the kind [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS].. we are a, -,,,,,,,,,,,...,,,,,,,,,,,,,,,,, w.,.,,,,,,,,,,,,,,,,,,,,,,, and,.,, calculates,,,,,,,,,,,,,,,,,,,,.,,,,.... the e - u has a range of,,,,,,,,,,,.,,,,, [SEP]", "detok_text": "[CLS].. we are a, -,,,,,,,,,,,...,,,,,,,,,,,,,,,,, w.,.,,,,,,,,,,,,,,,,,,,,,,, and,.,, calculates,,,,,,,,,,,,,,,,,,,,.,,,,.... the e - u has a range of,,,,,,,,,,,.,,,,, [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] - - all in the final game of the season - - were confronted by someone in their car. [SEP] he told the rest of the group to get up to the back of the building, and a a and and out into the road. [SEP] \" they will have have a way, he is going to give us a lesson. \" [SEP] a a a a... [SEP] the number would be $ 1, 000 by the end of the year, and a the, and and and andy of the sames. [SEP] on the point in the area, there are no people in the area, he said. [SEP] the [SEP]", "detok_text": "[CLS] - - all in the final game of the season - - were confronted by someone in their car. [SEP] he told the rest of the group to get up to the back of the building, and a a and and out into the road. [SEP] \"they will have have a way, he is going to give us a lesson.\" [SEP] a a a a... [SEP] the number would be $1, 000 by the end of the year, and a the, and and and andy of the sames. [SEP] on the point in the area, there are no people in the area, he said. [SEP] the [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS], 37,,,,,, 21, 26, 26, 37,,,.,,,,,,, 2007. [SEP] for the period - 21, 26, 21, 31, 37, 31, chicago - -,, 26,,, 36,,,,,, 51, 48, 37,, 21, 37, 37, 37,, 37, 37,, 16,,, 14 - 16, 23,,, 14 - 16, 37, 48, 37,, 16 - 16, 16 - 14. -, 14,,,, 17, 37, 37, [SEP]", "detok_text": "[CLS], 37,,,,,, 21, 26, 26, 37,,,.,,,,,,, 2007. [SEP] for the period - 21, 26, 21, 31, 37, 31, chicago - -,, 26,,, 36,,,,,, 51, 48, 37,, 21, 37, 37, 37,, 37, 37,, 16,,, 14 - 16, 23,,, 14 - 16, 37, 48, 37,, 16 - 16, 16 - 14. -, 14,,,, 17, 37, 37, [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] ' s,,,,........,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and,. [SEP] for that words, the likes of the oregon, chicago, illinois, illinois,,,,, are in the most back - to - back,,,, way. [SEP] the [SEP]", "detok_text": "[CLS]'s,,,,........,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and,. [SEP] for that words, the likes of the oregon, chicago, illinois, illinois,,,,, are in the most back - to - back,,,, way. [SEP] the [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS] out of the road, and a and and and have - the widening. [SEP] a few thing was out for nothing. [SEP] ( ap ) - china ' s economic would systems have a significant part of the world, in the north, and the rest of the world, according to the report. [SEP] in fact, the number of for for was of wass, [CLS] 14, 24,,, 2006 ). [SEP] the league ' s rookie all - star isn ' t the only one who seems to be on the court. [SEP] the company is expected to be 1, 000 jobs, and,,y said. [SEP] the [SEP]", "detok_text": "[CLS] out of the road, and a and and and have - the widening. [SEP] a few thing was out for nothing. [SEP] (ap) - china's economic would systems have a significant part of the world, in the north, and the rest of the world, according to the report. [SEP] in fact, the number of for for was of wass, [CLS] 14, 24,,, 2006 ). [SEP] the league's rookie all - star isn't the only one who seems to be on the court. [SEP] the company is expected to be 1, 000 jobs, and,,y said. [SEP] the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] in and,, and and and and ). [SEP] dr. michigan, michigan, michigan, michigan, s.,., michigan, michigan, michigan, michigan, ohio, etc. [SEP] but, by the end of the year, the number will be to than 1 %. [SEP] by the time he was be out of the political again. [SEP] i ' m not sure, but, have,,,,,,,,ical allss in the us, canada, texas and texas. [SEP]......,.,. and............ [SEP]", "detok_text": "[CLS] in and,, and and and and ). [SEP] dr. michigan, michigan, michigan, michigan, s.,., michigan, michigan, michigan, michigan, ohio, etc. [SEP] but, by the end of the year, the number will be to than 1 %. [SEP] by the time he was be out of the political again. [SEP] i'm not sure, but, have,,,,,,,,ical allss in the us, canada, texas and texas. [SEP]......,.,. and............ [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS], period, time to time. week of december 1. period to. days in a number of days, week to days in a, period, period, period, period, period,, period. [SEP] it is period, period, period of the period, period, period. period, period, and period. week, period, period, period, period, period, period, period days, change of days, period, week of the same period, week. week, period, period, period, period,, day, period, period, period,. period,, period, period, in a, period [SEP]", "detok_text": "[CLS], period, time to time. week of december 1. period to. days in a number of days, week to days in a, period, period, period, period, period,, period. [SEP] it is period, period, period of the period, period, period. period, period, and period. week, period, period, period, period, period, period, period days, change of days, period, week of the same period, week. week, period, period, period, period,, day, period, period, period,. period,, period, period, in a, period [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] [SEP] the company continues to have a full year, year, year, year, and return to a full schedule. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS] [SEP] the company continues to have a full year, year, year, year, and return to a full schedule. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] addition, the rubber coat, comes with unique decorative flavors, such as the rubber coat and the purple mask. [SEP] he became more worried about any future, he said. [SEP] houston ' s loss to detroit in the final game of a series of road - game series. [SEP] i do want to leave the room for a long conversation. [SEP] once again, he knows how to do his job. [SEP] the answer will be limited to,,,,,,, at least. [SEP] they have the bottom end of the road,,,,,,,,,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS] addition, the rubber coat, comes with unique decorative flavors, such as the rubber coat and the purple mask. [SEP] he became more worried about any future, he said. [SEP] houston's loss to detroit in the final game of a series of road - game series. [SEP] i do want to leave the room for a long conversation. [SEP] once again, he knows how to do his job. [SEP] the answer will be limited to,,,,,,, at least. [SEP] they have the bottom end of the road,,,,,,,,,,,,,,,,,,,,, [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS],,,,, period -,,,,,,,,,,,, and, end of the period, period,,,,,, period to period, period, and, period, period, period, period - period. the date,,,,,,,,,,, and, has the ability to track,,,, period, period, place, start to the year,,,,,,,,, and number of period. [SEP] in the end, the back - up eliminates the illusion of the in the end of the original structure. [SEP] he would have [SEP]", "detok_text": "[CLS],,,,, period -,,,,,,,,,,,, and, end of the period, period,,,,,, period to period, period, and, period, period, period, period - period. the date,,,,,,,,,,, and, has the ability to track,,,, period, period, place, start to the year,,,,,,,,, and number of period. [SEP] in the end, the back - up eliminates the illusion of the in the end of the original structure. [SEP] he would have [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS], chicago, chicago, chicago, end of the day, chicago,, chicago, chicago, chicago,,,,,, chicago, chicago,,,,, chicago, chicago,,, 37, 37, 36, week and the correspondingly beautiful days. [SEP] the third day of the day was marked by the remarkable talents of joe cowen. [SEP] for today, the week has moved from days,, days, days, to december,,, and december. [SEP] 21, 2007,, 2007, and the last 14 days of the year., 31,,,,,,, december, 2007. [SEP]", "detok_text": "[CLS], chicago, chicago, chicago, end of the day, chicago,, chicago, chicago, chicago,,,,,, chicago, chicago,,,,, chicago, chicago,,, 37, 37, 36, week and the correspondingly beautiful days. [SEP] the third day of the day was marked by the remarkable talents of joe cowen. [SEP] for today, the week has moved from days,, days, days, to december,,, and december. [SEP] 21, 2007,, 2007, and the last 14 days of the year., 31,,,,,,, december, 2007. [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS], will have been advised to take pre - trip flights due to non - cancellations. [SEP] multi - region, mid -,, day of north -, eastern, east - atlantic, east - atlantic, south -,,, mid -,, mid - atlantic, chicago, chicago, chicago, and chicago,,, western, chicago, and chicago, chicago, chicago, chicago, and,, chicago,,,,,, and chicago, north - to - north, u. s. 78, eastern, eastern, eastern,, and eastern, mid - atlantic, chicago,,,,, and. [SEP]", "detok_text": "[CLS], will have been advised to take pre - trip flights due to non - cancellations. [SEP] multi - region, mid -,, day of north -, eastern, east - atlantic, east - atlantic, south -,,, mid -,, mid - atlantic, chicago, chicago, chicago, and chicago,,, western, chicago, and chicago, chicago, chicago, chicago, and,, chicago,,,,,, and chicago, north - to - north, u. s. 78, eastern, eastern, eastern,, and eastern, mid - atlantic, chicago,,,,, and. [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] have have have, in the confluence of the celtics and the pistons, and have the best is to the thes in the basket. [SEP] the a -yy, with ofs, and the, and the out of the sand and and, of a single basis. [SEP] the following included, atlanta, atlanta, chicago, chicago, boston, chicago, chicago, chicago, chicago, new york, chicago, etc. [SEP] chicago,, chicago, chicago, chicago, to,ca, 2004 - h2.... [SEP] the idea is is have, have and, with a few, and and and and. [SEP]", "detok_text": "[CLS] have have have, in the confluence of the celtics and the pistons, and have the best is to the thes in the basket. [SEP] the a -yy, with ofs, and the, and the out of the sand and and, of a single basis. [SEP] the following included, atlanta, atlanta, chicago, chicago, boston, chicago, chicago, chicago, chicago, new york, chicago, etc. [SEP] chicago,, chicago, chicago, chicago, to,ca, 2004 - h2.... [SEP] the idea is is have, have and, with a few, and and and and. [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/state_c256_t1p45_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/state_c256_t1p45_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..db99c4f974c1bea4bafec05a5814b1e6f160a5d3 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/state_c256_t1p45_detok_raw_samples.txt @@ -0,0 +1,228 @@ +state_c256_t1p45_detok +{ + "type": "summary", + "name": "state_c256_t1p45", + "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", + "step": 124000, + "decode": { + "kind": "categorical_fullvocab", + "config": "state_c256_t1p45", + "steps": 16, + "model_t_mode": "post", + "support_power": 1.0, + "semantic_power": 1.0, + "endpoint_temp": 1.45, + "concentration_min": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 42.769466206615945, + "nll_per_token": 3.7558244416048425, + "tokens": 8694 + }, + "diversity": { + "sample_entropy": 3.1708587735321347, + "unique_tokens": 1049, + "token_count": 8192, + "distinct_1": 0.1280517578125, + "distinct_2": 0.41313976377952755, + "top_token_mass": 0.22607421875 + } +} + +===== sample 000 ===== +[CLS] for here, "he said. [SEP]" when we get a feeling of what's right, the numbers are up, down, in the end, down, " he said. [SEP] i thought of the,,,,, end of december, etc. [SEP] for days, we believe we have a half - a sense of the end of the past, but of the, one that have come at the end of the world. [SEP] and here, then, here and then, and oh, the world's coming, here, a bit, it's like - - the idiots,,,,,, [SEP] + +===== sample 001 ===== +[CLS] expected to see a number of improvements in the first half of 2009. [SEP] 11, 2001, in the playoffs, the playoffs, in the east. [SEP] a day - to, day - day,, day - to - day in the region, was the june period, 2008. [SEP] never, never, never, but you have to feel that way, as you know always, day, day. [SEP] a bunch of tough, emotional, insightful, self - destructive co - people, and, have been the right part of a relationship together. [SEP] and that is, of course, the place to have power. [SEP] [SEP] + +===== sample 002 ===== +[CLS] tomato, red,, tomato, vanilla - potato, and vanilla. - - fresh potatoes. - - peanuts with water, red vanilla,, cinnamon of skin, red leaf and truffle with a lemon. [SEP] " this is the last chance here. [SEP] in chicago, boston, chicago, chicago, chicago, chicago,,,, chicago, and, in the midwest, the north, and the jersey. [SEP] he, he made the basket and carried the ball in the third quarter. [SEP] the government also declared state of emergency that they have paid more than $40 million in illegal fees. [SEP] the crash in virginia [SEP] + +===== sample 003 ===== +[CLS] of the..., chicago, chicago, chicago, chicago, chicago, march 16, 2007, and the chicago, chicago, chicago, boston,, chicago, and chicago. [SEP] chicago, 2006. - - boston,..., for new york,,..., london -,... - -,., in the area of days, 2006, on days, 2007. - -, for a late day and date. [SEP] boston, - to - boston, early afternoon, boston, to - back, again - - session, early afternoon, again - - is a good place to [SEP] + +===== sample 004 ===== +[CLS] 1996 - 98. [SEP] he kind of gets up to the night, but when no one's listening, he's in the room. [SEP] he said.... kind of universal health care - the - - and like - all of u. s. - -..., and.... [SEP] chicago, new york, chicago, detroit - -,, chicago, chicago, boston, chicago, new york, chicago, chicago,,,,,, etc. [SEP] at chicago, boston, the chicago, chicago, boston - chicago, chicago, chicago, chicago, chicago, chicago, chicago [SEP] + +===== sample 005 ===== +[CLS] [SEP] for one thing, mr. lombardi, i know, then,, then,,,,,,,,,, to,, to leave. [SEP] it is alleged that he had performeded the act of making payments to the people they work. [SEP] it started in 2002. [SEP] he starts with a simmering chuckle. [SEP] the win would be the first post - season win for the scarlet,, who rebounded from the playoffs and beat chicago 16 - 7. [SEP] for now, he is about the start of a new world order. [SEP] the knicks (2 - 14) have won three games to the [SEP] + +===== sample 006 ===== +[CLS] to be a sign of that.. the beginning to come back in the back to the end of...., and the black christmas period, which is in the form of the black period. [SEP] "is the government going to increase the tempo of the line? [SEP] if the program is moving and fails to pass, the lights will turn and drop, and the focus will turn back to" ohio, " the message and back, lahooda said. [SEP] two - hour events is free, from three - hour to 12 - hour meetings. [SEP] a large - pan add together the bread peppers and bring them to [SEP] + +===== sample 007 ===== +[CLS], 50, 50, 50, 50, given the choice of, with the clear "line" on the importance of the point, and, up to 18.... lob - - - - pb.. [SEP] s. david cohen, an aviation expert in soil growth and sustainable waste management in independence, ill., said this is part of studies of aviation safety in the countries. [SEP] on the way that he has it, the colors of the keyboard, the fluorescent line, with the of a pin, the doo - dae - doo. [SEP] a few weeks into the market, the leading price of [SEP] + +===== sample 008 ===== +[CLS] to pay her decision. [SEP] chalk,, top,,,,, carrots, place, packet, place, top,, line, line to the top and the end of the cake. [SEP] trying to stay in the playoffs, after chicago, re - host detroit in a stunning 97 - 14 win in miami. [SEP] two women have moved to the house for years, allowing the teams to play the next game. [SEP] we are not,, want to talk, we look at the walk, we say, " at the same time, show you what they means, and tell you, what they means is.. [SEP] + +===== sample 009 ===== +[CLS] - - to - date - - - - - - - - - - - - - of - 13, 657/21, 121 - - 07, 07 - - - - zone - 16, bling2. - - 21, hamilton - of - 65, - 14, point - of - - - - - -, 21 -,, - - - - - - - - - -, - 11, 31, - 21, 31, and - - list, 31 - 38. 101. - - - - - -, - -, - - - -, as if it were to -, [SEP] + +===== sample 010 ===== +[CLS] to - 08. 1, week - to - week, -, back - to - days period, period and back - to, back - to -, 14 - to, and -, back - to - date.... [SEP] the recession will be be in the end, of the spring, and likely to take place for the rest of the remainder of 2008, " na zeit said. [SEP] however, again, in the next few days, the company's strategy comes to the end - - in a scale - - the time - time of a 14, 15 - 50, 10 - 50,, [SEP] + +===== sample 011 ===== +[CLS] of vanilla - whole bread, vanilla, back - bacon, potato flour, bread - potato bread, - bread, the butter, fresh bread, vanilla - potato mix, and - potato, bread bread, a whole - piece, bread and pie - in - side of the meal, to the mix, over - the - ground, bread - cheese bread. [SEP] finally, the knicks seemed to get in the lead, falling to 14 - all at the end of the third. [SEP] he didn't have them. [SEP] the types of teams - - 50, 50, 60, and - - are, would seem to be [SEP] + +===== sample 012 ===== +[CLS] they are facing the 20 -,,,,, 14.,,, period,,, 16 -, and 20 -,, it,,,,,,,,,,,,,,,,, and,,, and' n - dub. [SEP] the line to eight operations to include locations in the 10th,, chicago,,, chicago, and chicago, in the chicago, chicago, chicago, boston, the chicago, chicago, and chicago markets. [SEP] many people believe the lack of sleep in the back rooms will make it difficult to walk for a meal and even for a cough. [SEP] [SEP] + +===== sample 013 ===== +[CLS] the... [SEP] in accordance with a three - year project, the nonprofit group was able to create a version of the center's family of primates, be able to show up in a tent and grow up own animals, the report said. [SEP] at least the lights will come on the airwaves. [SEP] take a light day, then back to the end of miami, then back to the end of the season - - say, back - to -.. and next to to the end...... [SEP] the beginning of the old process can take the balance, take the time for unity and [SEP] + +===== sample 014 ===== +[CLS] to the end........ [SEP] the 20 - foot -, 6 - foot - 11 (swine flu - 16,, 16, 55 - -, 20 -,, 14) in non - - period, of - season or end - points, such as "16," 60, 98, 16, 98, 14,, 73, 15,, 16,, 16, and,, - 14, respectively. [SEP] 16, 14,, 12 - 16, 12 -, and 11 - 14.. [SEP] michigan, indiana, michigan, ohio, michigan, illinois, and, [SEP] + +===== sample 015 ===== +[CLS] of - air flights, 49, and 44 in the combination of the denver, chicago,, and - - - the problem is, chicago, 80,, and chicago, to - 49, - air - to - air to - air aircraft, and the aap officials said the plane lost power when it crashed into a rochester, massachusetts, in december. [SEP] he hit once a week, once and again. [SEP] put a large butter in a boil - to - the oven. [SEP] still, ted mccarthy, the potential attorney, was back in the first game to minnesota. [SEP] the three - time al mvp, in a [SEP] + +===== sample 016 ===== +[CLS],,,, of the great,,,,,,..,,,,,,,,,,,,,,,...,,,,,,,, of the,,,,,, of the,,,,,,,,,,,,,,,,,,,,,,.. [SEP] the inches we have,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, is true. [SEP] the hat,, - - are slippery,,,, [SEP] + +===== sample 017 ===== +[CLS], the chicago in and the detroit in chicago. [SEP] the fifth, the final game of the season of chicago, the white bulls, the celtics and the knicks, is to be played in the chicago suburb against the phoenix, on jan. [SEP] but we can't put it away. [SEP] it is detroit's first win of the division series. [SEP] he was out of words, and not of his line. [SEP] and it didn't work for days, work for days - - wait for days to days - - time to work day for day. [SEP] today, it,, cells, not nothing. [SEP] he [SEP] + +===== sample 018 ===== +[CLS]., "........ to,...,,,,,,,,... [SEP] we have 60,,,,,,,,, and still,.. [SEP] we say...,, on,, the boston,,,,,, we talk about,, to,,, same time as, nyt, chicago, chicago, chicago,....,,,...,,,,,,,,,,,,,...,,,,....,, to,,. [SEP] + +===== sample 019 ===== +[CLS] £1, 000, 000, for treatment for a depression. [SEP] i don't see in number, however, the number 60,,,, the year 31. in terms of the stock - devaluation, 20, 65, 30,, 26, 37, 37, 49, 37, 37, 73, 37, 892,,, etc. [SEP], 73, 60, 98, 73, 98, 451. 5m 17, 17, 16, 21, 22, 21, 26, 26. [SEP] 577, 562, 1,18. 45 information. [SEP] i know.. [SEP] + +===== sample 020 ===== +[CLS] 14 - 14....... [SEP] chicago biner killed stephen jones of boston university in morgantown, ohio, on friday, 26, 2007, at 10: 40 a. m., at his home in flint, ohio, police said. [SEP] but this article is not meant to say,, he's going to change. - - - and, oh, the end of the post - 9 - era fret of "wrong" is, apparently, the "use of a word, he's a real person, he's a real person," in the front line, that he [SEP] + +===== sample 021 ===== +[CLS]. [SEP] a, begins,,,,,,,, for,,,,,,,,,,,,,, is done with a non - stick,, - - - made of of the top - end, flour. [SEP] " you are going to have,,,,,,,, the,,, the,,,,,,,,. [SEP] that is,,, -,,,,,,,,,,,,,,,, and to the end. [SEP] the team, back in the end, but they have to return to the top.. [SEP] + +===== sample 022 ===== +[CLS].. [SEP] 6 - -, l., a., 28 -,,,,,.. [SEP] in some circumstances, the members of congress would have a chance to work together. [SEP] and there is a combination of,,,,,,,,,,,, the,,,,,,,,,...,, in,,,,,,,,,,,,,,,,,,,,,,,,,,,, in -,,,,,,,,,,,,,,,,,,,,,, [SEP] + +===== sample 023 ===== +[CLS] - 18, 52 - 14 ), 55 - 14. in addition, 50 - 73, 16 - 38 - 73 - * (18 - 98 %), in combination of the near - end nature of the solution and the off - the - line -, on - the - soft - end, the solution, solution for our product line. [SEP] in detroit, chicago, detroit in detroit, detroit in chicago, detroit, detroit,., in chicago and has included the detroit, bulls, the pistons and the bulls, the detroit bulls, and - chicago. [SEP] the company owns an additional $17. 2 billion of [SEP] + +===== sample 024 ===== +[CLS] to achieve their work goals by making their trips,, - - 13, 14, 13, 12, 12, 14, and days. [SEP] they will finish in august. [SEP] at some point, we would feel like that, "he added. [SEP] there is further information for,, then, 2004,, period,,, and period. [SEP] 14, and he will for a three -, 12 - day, 4, half -, 12 - session. [SEP]" chicago, boston, chicago, chicago, chicago,, chicago, chicago,,, chicago, chicago,, chicago, drogba said. [SEP] [SEP] + +===== sample 025 ===== +[CLS] what their career can do. [SEP] but the answer was still in doubt, due to harrazard eating at a train, after days, a couple of days, and trying to find if they wished to remain. [SEP] a little luck with the cinnamon juices of the mushrooms, w. a bit of the sauce. [SEP] they don't know that it is the word,,, the word, the word "not...." [SEP] the jets took their chance to get back to the playoffs in time. [SEP] the jets took the lead in detroit on an afternoon, and the jets took the rest of the third [SEP] + +===== sample 026 ===== +[CLS] - - months, 7,, 13 days. [SEP] 14, 2007. [SEP] the earth has a lot of hope. [SEP] he really wants it. [SEP] - - in rpm's 14 - 5, which is located. 2 days of the week in order - - 18, 37 - - 14, 54. - -., 38 16, 37 16, 39 13, 16 - 14, and chicago - - 24 - day - - 14. - - - 13, 13, 14, 13 - 15, 11, 14, 11, and a,, 13, 15, 16,,, 16, 18, [SEP] + +===== sample 027 ===== +[CLS] a small moment. [SEP] the 20 - year - man, who has not been named for the incident, was last seen. [SEP] have the courage to try again with the courage and the, and with the time to eat and work... [SEP] it is, to, say, a, a necessity. [SEP] he's just trying to get out of the way of a crisis - - and he tries to find a solution to make it better and better. [SEP] you have to put the knife to small pieces to arrange on the top, put a date in the middle and bring the rest of the flour to pieces. [SEP] [SEP] + +===== sample 028 ===== +[CLS] - 16. 55 - -, (17), 21 - 60 - (12) - 60, 16 - 31 - - - - 16 - 17. 16, 18. 16, 37 - - 16 - 31 - 1 - 3, 000. 13 - 23, 73 - - place. 16 - 31 - 36, - - - -., -,, 49, 38 - 37, 49 - 16, 49 - 37 - 37 - 112. [SEP] do you really want to - - 20 - - 19 - 37 - b, bhutto 17 - - -, - - -,. - - - [SEP] + +===== sample 029 ===== +[CLS] have children, think it's time for her to tell her story, and get to be the best friend in her family. [SEP] i was hit by a string of changes in chicago,, chicago, chicago, chicago,,,,,,,,,,,,,,,,,,,,,,,,,, and,. [SEP] the pistons have to move back, and down the road for detroit, boston, and detroit. [SEP] he returned to the lineup, leaving with back injuries. [SEP] when all the ballots have been turned, in michigan, chicago, florida, chicago, chicago, and [SEP] + +===== sample 030 ===== +[CLS] have to struggle to balance the race with a place in the title. [SEP] in the beginning and top of it, he has asked, "no have ever come to the top of the reality and take all the wheels, back, back and back," he said. [SEP] in the event,,,,, weeks, weeks,,,,, and turns out, day, day, a day, week,,,,,,,,,,,,,,,,,, and on the other side. [SEP] there was a bit of something to sit in the street, not the front rooms. [SEP] [SEP] + +===== sample 031 ===== +[CLS]..... in line for the week of december, 50, 000. [SEP] and as you point out, the first line is more than 1, 000 words. [SEP] the 24 - hour, back - to - back runs in the markets - - boston, chicago, boston - to, boston, mid - ohio, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, detroit,, chicago, chicago,,,, chicago, st., chicago, chicago and miami - to,,,,,,,,,....... a.,,.. [SEP] + +===== sample 032 ===== +[CLS] kind of business, - - 2007. [SEP] detroit 16, chicago, boston 88, 50 - 73, 50 - 95, the detroit, chicago, chicago, detroit. [SEP] in chicago, chicago - - - -, to have been traveling for at least 36 hours, on a 1, 000 - mile, chicago,, chicago, chicago - area and then on a private plane to cover the same - - 12 - 24 hours a day, 14 - 14,, a train to chicago, one - 12, 11, 14 - 14, and, to complete the one - hour, 12 - 14 -,, 12 - [SEP] + +===== sample 033 ===== +[CLS],, 50, 50,,,,,,,,,.. [SEP],,, 51, 89,,, 51, 52, 48,,,,,,,,,. one of these days, 50, 50, 50, 50, 60,, 89, 60,,,, 89,,,,,,, 89, 60, 60, 51, 50, and,...,,, 50,,, 52,,,,,,,,,,,,, etc., indiana, indiana, michigan, ohio, indiana, illinois,,,, [SEP] + +===== sample 034 ===== +[CLS] - 13, -, - 8 - 0 - 0... - 11 - losses. [SEP] in addition, the first half of the user's consonants are meant to be "a.," 8,,, 12 - 60, "b," 60, " "10 - 80," 12 - 70, beginning of the 80's, i, a, s, and in some way they are, ", to ",,, ",, ",, "or," " to other name. [SEP] it is now hard to explain how the situation was so similar to their sex. [SEP] [SEP] + +===== sample 035 ===== +[CLS] ), 49 - points. [SEP] 3 - 14 - - boston, a. -, - 16 - 00, and a. j. b., 12 -, - 14 - 00 to mid - morning trade. [SEP] a 2 percent decline from the 0. 5 - point - to - point - in - the - year average return of 1. 5 per cent. [SEP] the bulls, 73, 73,, 87, chicago, 24 - of, 41, 73, 50, 73, and 68, to the hawks in., boston, chicago, chicago. [SEP] the men, who, and two, of the [SEP] + +===== sample 036 ===== +[CLS], - 73, - 16, 13,, -, - 14, at - 16, at - 16, 73, ticker,,, 52, one of the franchise's best. [SEP] the helicopters, including two british pilots, have made hundreds of short - flight visits. [SEP] 13, detroit, 8 - 14. [SEP] but the savings of health - care are not applicable to many americans. [SEP] mr. zaff, 54, arrived at the end of the afternoon throngs of nearly 1, 000 people. [SEP] what a clever joke. [SEP] well, look for a couple of days, if said, [SEP] + +===== sample 037 ===== +[CLS], 37, 37, 37, 37, 49,,,,,,,,,, 49,,,, 49, the term " 48,,, 48, 48, 52,,,,,,,, and etc. [SEP] the first national recession ended in the us in december. [SEP] bridge2. [SEP] 18,,, 21, etc., 16, 23, 21, 37, 31, 50 % in 24 - 37 minutes (18 - 40s, and 21 - 50s, etc. in less than three minutes), 30 -,,,,,, 37, 48, [SEP] + +===== sample 038 ===== +[CLS] to shut by the end of 2008. [SEP] ted kennedy, a mother, died of cancer. [SEP] and then, back to your place. [SEP] in the end the game at right flanker brandon moss was the way it was. [SEP] the lead is at 10 - 20. [SEP] the magic number is around 100, and the answer is to reckoning it's only 20. [SEP] for a long time, not days. [SEP] i'm really trying to return to detroit, too.... [SEP] a little - thaned majority has in a couple of shaky runs in boston, and the first in the best - - [SEP] + +===== sample 039 ===== +[CLS], days, boston time, d, chemph, canada time and again, detroit, boston, chicago, same place, boston again, chicago, chicago, all days, again, to the spring, again, again, and next time to put him back and see if he just try to move, from time to time... president karzai is the time for him..., again, for the place to move, and he the time to date, time to time... [SEP] time to move to the top, get back to the top, time to finish. [SEP] and itʼs [SEP] + +===== sample 040 ===== +[CLS] we are the first country of the world to pay 7, 000.... well, this is the most of the year in all, "the president said. [SEP] later in the week," the statement said. [SEP] he take the road on the road.... take the road, take the road to take the end of the road,, the road, to to the road in the middle, rather than take the road to the road, to get to nowhere, and thus, have to have to move, in order to move on a sort of path. [SEP] in addition, the united administration has been [SEP] + +===== sample 041 ===== +[CLS], 18 - 21, 16 - 14... 14 - 21, 17 - 18, 37, 51, 37 - 37, and 7. 30, 14 - 16, 24, 24.., -, 13 - 14, 14 - 15, 23 - 14, and 14, 14, 16 - 14, 14 by the sc. [SEP] 13 - 14,, 37, 16 -,,, 73, 60, 49, 48 - 49, 45 - 37, and 49, 37, and,, 37, 37,, date of the,, 31, 37,,,,,,, the [SEP] + +===== sample 042 ===== +[CLS] - or less, or,, day, back, a, two days in the kitchen. [SEP] assistss, detroit 90, chicago, detroit 89, chicago, chicago 89, chicago, chicago 89, chicago, chicago. [SEP] in the last few days, we have a 65, 000 - to - 1, 300 - capacity schedule. [SEP] given the current economic climate, i know it would also be a lot. [SEP] are you over worried? [SEP] but the talks aren't about to change the relationship and provide some change. [SEP] " i can see that it doesn't work for us. [SEP] a statement to the [SEP] + +===== sample 043 ===== +[CLS] said. [SEP] the week was the week,, and hour of rest, period of work. [SEP] that means,, time and time - - and time was extended,,,.,, and,'s......, 13, 26,... and the number,,,,,, 38, etc. [SEP] in course, if you a woman is have the opportunity and the opportunity to make the show, she'll be able to do that in a couple of of days. [SEP] that's not to say the term "crisis" will give up to the turmoil in the region [SEP] + +===== sample 044 ===== +[CLS] -, say, 14 -, - 08, and that is, waiting for their own assets to be wiped out. [SEP] 50, 98 - 70, 98 - 70, 73 -, 50, 73 -, 30, 37, and 38, to 49, to 1, 31, -,, 37, -,, 18 - 15, 31 - 48, 52 - 30,, 52 - 45 days. [SEP] the plan plans to pay a minimum end - to - end - - in kind of, december to end 2009, at, $41, 000, and then, in order to prevent any of the capital [SEP] + +===== sample 045 ===== +[CLS], he said. [SEP] i have been 50 and working three times in the past two years. [SEP] the idea is to bring the passengers and bring the next train to chicago, at one point.. [SEP] however, mr sahn does not understand, that even one of the other people in power has such attention. [SEP] what we is a mix - - mix, vanilla - ice vanilla, sour milk, dark bread, vanilla, warm milk puree, buttery bread, deep vanilla, fresh vanilla, red and vanilla, fresh sour, fresh milk cheese, vanilla, fresh breads, vanilla, sour bread, fresh milk, [SEP] + +===== sample 046 ===== +[CLS], 1996, boston, 1996,,, 2004, " a period that has lasted for a year in the first half of the season, not a full year. [SEP] 13, chicago, 11, 10, chicago, -,, 7, 732, 400, 6, 900, 000 - - all built from the top of the pile. [SEP] he then dressed in a black tie, took a chicago - style flight, and then a flight to chicago, chicago, chicago to chicago, chicago, boston, chicago, chicago, chicago to boston,, chicago bulls, chicago, chicago, chicago etc. [SEP] the company, [SEP] + +===== sample 047 ===== +[CLS] cars, and children, on the road. [SEP] in fact, mr brown's school has never back on its own. [SEP] place the tomato place in the middle place, the place on the ground, the top - in place, two in the top, the top, place, place and one in the bottom, in place with the flour back on the ground. [SEP] the talk is based on the basis that his point was, line, line, line in,, line in the line,,,,, for one.,, and it's line - a - back,,, and,,,, [SEP] + +===== sample 048 ===== +[CLS] a day of days, but a day the week, not, the week,........ [SEP] at a cost of a thousand or 50 dollars, it is going to be "everything that ends with a lot of money," mancini told the news. [SEP] companies and we need to have a good relationship to customers. businesses, technology and the manufacturers of large power products and high - service products. solutions. [SEP] when he asked to look at the tv guideline, the reporter he was able to find access to thousands of information and learn what other news media would to do: get access to the [SEP] + +===== sample 049 ===== +[CLS] costs that will make up for tens of millions of jobs. [SEP] it's not the end of the olympics, here, anyway, in chicago. [SEP] not to have it, anyway. [SEP] the series ended in a tie before the series began in chicago. [SEP] in a minute, prepare, and you, to turn,,,, flip - -, grind, stack, slice, and - - - for the past 2 hours. [SEP] i'll never make a case. [SEP] but with a clear, breakfast, a beer, a soup, two bread, all that stuff,.. [SEP] no regrets. [SEP] he [SEP] + +===== sample 050 ===== +[CLS] - - - 5. - -, 37, 48, - - - 13. [SEP] "the time the moment changes everything, there's a bit of continuity, a kind of a break, i think - - - - - - - - - - - - - - - - - - - - - - - - - -," he said. [SEP] in the past couple of seasons, the field of - - - 14, 16,, 16, 16, 24, 16, 24,, 20, 30,, 30, 50, and acs. - - was the first two games of the series [SEP] + +===== sample 051 ===== +[CLS] 24. 7. - 24 - 24, 14 days 24 - 24 - 7 days - - 24, 48 - 24 days, february 24, february 24, 24 - 16, 24 - 23. 4 days in pre - 24, days 33, even in the middle of the day, 24 - 24 - 26. days time to day - (telecoms, 481. 13 - 26, 24, 48 -,. - ba. co. uk). 7 days has 3. 4 hours, 73 days but has a few days, and is on the right to week 24 - 24. days on a 13 - [SEP] + +===== sample 052 ===== +[CLS] have been doing so in the middle of december. [SEP] 13 of 1996 - 73. [SEP] mr. jordan, who is just weeks, is to end his writing assignment. [SEP] the tomato is a bit in the process of baking, and add a little to make a good pasta feel. [SEP] the period would still run to days, days, days, days and even days. [SEP] the camera is in the chaos, and in the end of the chaos, the lights are white. [SEP] but a lack of activity in the second quarter could mean profits in the run up to the current level of 50p, he said. [SEP] " [SEP] + +===== sample 053 ===== +[CLS] time to turn, period to end, period, period,,, and back - time. [SEP] 12 - 14, 14 - 14. [SEP] year 7, 26,, 38,, 37,, 16, 15, 17, 15, 36,,,, 48.,, 48, 48, and 48,,,,,, and, time to date in the same period. [SEP] a great sense of it is that the end of the economic century was over. [SEP] look at that, 16. 5 % (and. 4 %). [SEP] the third man, between the 50 and 90, is the [SEP] + +===== sample 054 ===== +[CLS] stands at the moment, 1, 0007. [SEP] and on days 14, 24,,,,, 18, 23, 36,,, 48, 37, 36,,,, 90 days, 36,,,, and, 36,,, 48,, 48, double - skied. [SEP] 14 when he was 46, and in he. [SEP] the nos. 5 - 13 season, game against ohio state. [SEP] to do, the worst thing of all is, to do, they will have to change the mind and in effect... and then he might throw on the door. [SEP] the [SEP] + +===== sample 055 ===== +[CLS] - - the road to finish, again, back to line, period, and back to again, back to 52. - - - - - back to back - - - - - - and back, again. -, err, back to finish - - and, eventually, time to stand in place, and, to, time to end up to, back, end, (in, end). [SEP] for example, the new approach, is seem to be a simple, back - to - end, designed to make the turn, end, end, and back - stop. [SEP] the penguins, 14 - 14 [SEP] + +===== sample 056 ===== +[CLS]. [SEP] chicago, washington - - 18 - 1 - 5 - 0 - - 0 - 3.... [SEP] it's time to know the meaning of the in the truth. [SEP] that's the end of the day, all of the actors come to the top. [SEP] by eliminating the effect in the midst of an upset with the playoffs, the patriots dropped out of the playoffs and losing with the playoffs, a and - 0 at the end of the best season of the 2004 conference championship. [SEP] provider - 3 is the only ethernet solution, and allows the use of multi - mode solutions. [SEP] however, [SEP] + +===== sample 057 ===== +[CLS] that it is going to be the end of the road. [SEP] a. i have a house,,,,,, in a small plane,,, on the airplane, in,, in anything that it is. [SEP],, stand on the spot, and then...,,,,,,,,,,,,,,,,,,,,,, the type of,,,,,,,,,,,,,,,,,,,, etc.,,, 50, 49,, 54, 00mph.,,,,,, 48 [SEP] + +===== sample 058 ===== +[CLS] [SEP] the company lost three operations in the end of 2008. [SEP] you need to get back to a simple date.... [SEP] if only, days, days, days, days,,,, days, days,,, period, to put them in 10, 10, 11. [SEP] if you have to speak something for you yet, you will have to call out the year,,, period, the year,,,,,,, period, and until the rest is same, period, period, to the end, the place of time, the time, place, the place, place, the top [SEP] + +===== sample 059 ===== +[CLS] uk, the company has has partnerships with other regional organisations, such as the royal and the british transport union. [SEP] he did not know if any other,,,,,,,,,, part of the original, was a series of elaborate tribbles. [SEP] i don't see the room for that to happen. [SEP] he is what i know is not going for a while, but he would be forced to take a conversation with his family, at least. [SEP] he doesn't know what the answer to be, is you to love your friends, but you need to talk together. [SEP] according to the [SEP] + +===== sample 060 ===== +[CLS] to increase the length and auto - end of the line to reach capacity for the post - trip 2008 miles. [SEP] the line, which hit the 16 - to - road - in line, formed from the main - - - - - - - line. - - - - - - - in - - - - - b/c the road - to - line -, line - to - line. road - to - place in the line - to - line, base line, top - line in the base line, top - line - in the line in the top, and in the 12 - and - 10 - line [SEP] + +===== sample 061 ===== +[CLS], goes to the heavy - metal ballads of the last british musical "days after the lights," for a paperback. [SEP] turn to the freshly - houdini breads, pick on the brilliantly sliced thick flavors of red bread and the crisply crisp potatoes. [SEP] what a place you are, go piece by piece, bring on the soften. [SEP] then,, then, then, now, then they get back together, to get up, sleep and... they are all just together... [SEP] a major part of the project. [SEP] 18, 2008 in the white house in washington, d. [SEP] + +===== sample 062 ===== +[CLS]... [SEP] "a lot of time is" due to the shortcoats. [SEP] the yarns are not thick enough in layers of linen - - -, - - -, - and, a - - - - and in short threads. [SEP] that is the case, a..., - double - area, double -, double -,,, -, -,,, in -, -,, -,,, -, -, -,, u. s. 78, b -,, b -,, -,,, -, -, and -, -.. [SEP] + +===== sample 063 ===== +[CLS]'s going to get a bit of work together and finish the relationship, then the momentum goes to the back, " he said. [SEP] instead, expect everyone in any given place - - with the service, but, on the train - - to have a spot in everyone's hand. [SEP] his appointment would be a significant blow in the face of the crisis as eu leaders struggled to elect the pro - european minister. [SEP] 22 - weeks (18), 13 days to work 12 - 14 (h2 - 19o), 24 - days..., 16 days twice a week, 14 - 12 weeks of [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/state_c256_t1p45_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/state_c256_t1p45_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..7233d8d40a4d4eb6d15987b7f651bb2dbe064619 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/state_c256_t1p45_raw_samples.txt @@ -0,0 +1,228 @@ +state_c256_t1p45 +{ + "type": "summary", + "name": "state_c256_t1p45", + "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", + "step": 124000, + "decode": { + "kind": "categorical_fullvocab", + "config": "state_c256_t1p45", + "steps": 16, + "model_t_mode": "post", + "support_power": 1.0, + "semantic_power": 1.0, + "endpoint_temp": 1.45, + "concentration_min": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 42.769466206615945, + "nll_per_token": 3.7558244416048425, + "tokens": 8694 + }, + "diversity": { + "sample_entropy": 3.1708587735321347, + "unique_tokens": 1049, + "token_count": 8192, + "distinct_1": 0.1280517578125, + "distinct_2": 0.41313976377952755, + "top_token_mass": 0.22607421875 + } +} + +===== sample 000 ===== +[CLS] for here, " he said. [SEP] " when we get a feeling of what ' s right, the numbers are up, down, in the end, down, " he said. [SEP] i thought of the,,,,, end of december, etc. [SEP] for days, we believe we have a half - a sense of the end of the past, but of the, one that have come at the end of the world. [SEP] and here, then, here and then, and oh, the world ' s coming, here, a bit, it ' s like - - the idiots,,,,,, [SEP] + +===== sample 001 ===== +[CLS] expected to see a number of improvements in the first half of 2009. [SEP] 11, 2001, in the playoffs, the playoffs, in the east. [SEP] a day - to, day - day,, day - to - day in the region, was the june period, 2008. [SEP] never, never, never, but you have to feel that way, as you know always, day, day. [SEP] a bunch of tough, emotional, insightful, self - destructive co - people, and, have been the right part of a relationship together. [SEP] and that is, of course, the place to have power. [SEP] [SEP] + +===== sample 002 ===== +[CLS] tomato, red,, tomato, vanilla - potato, and vanilla. - - fresh potatoes. - - peanuts with water, red vanilla,, cinnamon of skin, red leaf and truffle with a lemon. [SEP] " this is the last chance here. [SEP] in chicago, boston, chicago, chicago, chicago, chicago,,,, chicago, and, in the midwest, the north, and the jersey. [SEP] he, he made the basket and carried the ball in the third quarter. [SEP] the government also declared state of emergency that they have paid more than $ 40 million in illegal fees. [SEP] the crash in virginia [SEP] + +===== sample 003 ===== +[CLS] of the..., chicago, chicago, chicago, chicago, chicago, march 16, 2007, and the chicago, chicago, chicago, boston,, chicago, and chicago. [SEP] chicago, 2006. - - boston,..., for new york,,..., london -,... - -,., in the area of days, 2006, on days, 2007. - -, for a late day and date. [SEP] boston, - to - boston, early afternoon, boston, to - back, again - - session, early afternoon, again - - is a good place to [SEP] + +===== sample 004 ===== +[CLS] 1996 - 98. [SEP] he kind of gets up to the night, but when no one ' s listening, he ' s in the room. [SEP] he said.... kind of universal health care - the - - and like - all of u. s. - -..., and.... [SEP] chicago, new york, chicago, detroit - -,, chicago, chicago, boston, chicago, new york, chicago, chicago,,,,,, etc. [SEP] at chicago, boston, the chicago, chicago, boston - chicago, chicago, chicago, chicago, chicago, chicago, chicago [SEP] + +===== sample 005 ===== +[CLS] [SEP] for one thing, mr. lombardi, i know, then,, then,,,,,,,,,, to,, to leave. [SEP] it is alleged that he had performeded the act of making payments to the people they work. [SEP] it started in 2002. [SEP] he starts with a simmering chuckle. [SEP] the win would be the first post - season win for the scarlet,, who rebounded from the playoffs and beat chicago 16 - 7. [SEP] for now, he is about the start of a new world order. [SEP] the knicks ( 2 - 14 ) have won three games to the [SEP] + +===== sample 006 ===== +[CLS] to be a sign of that.. the beginning to come back in the back to the end of...., and the black christmas period, which is in the form of the black period. [SEP] " is the government going to increase the tempo of the line? [SEP] if the program is moving and fails to pass, the lights will turn and drop, and the focus will turn back to " ohio, " the message and back, lahooda said. [SEP] two - hour events is free, from three - hour to 12 - hour meetings. [SEP] a large - pan add together the bread peppers and bring them to [SEP] + +===== sample 007 ===== +[CLS], 50, 50, 50, 50, given the choice of, with the clear " line " on the importance of the point, and, up to 18.... lob - - - - pb.. [SEP] s. david cohen, an aviation expert in soil growth and sustainable waste management in independence, ill., said this is part of studies of aviation safety in the countries. [SEP] on the way that he has it, the colors of the keyboard, the fluorescent line, with the of a pin, the doo - dae - doo. [SEP] a few weeks into the market, the leading price of [SEP] + +===== sample 008 ===== +[CLS] to pay her decision. [SEP] chalk,, top,,,,, carrots, place, packet, place, top,, line, line to the top and the end of the cake. [SEP] trying to stay in the playoffs, after chicago, re - host detroit in a stunning 97 - 14 win in miami. [SEP] two women have moved to the house for years, allowing the teams to play the next game. [SEP] we are not,, want to talk, we look at the walk, we say, " at the same time, show you what they means, and tell you, what they means is.. [SEP] + +===== sample 009 ===== +[CLS] - - to - date - - - - - - - - - - - - - of - 13, 657 / 21, 121 - - 07, 07 - - - - zone - 16, bling2. - - 21, hamilton - of - 65, - 14, point - of - - - - - -, 21 -,, - - - - - - - - - -, - 11, 31, - 21, 31, and - - list, 31 - 38. 101. - - - - - -, - -, - - - -, as if it were to -, [SEP] + +===== sample 010 ===== +[CLS] to - 08. 1, week - to - week, -, back - to - days period, period and back - to, back - to -, 14 - to, and -, back - to - date.... [SEP] the recession will be be in the end, of the spring, and likely to take place for the rest of the remainder of 2008, " na zeit said. [SEP] however, again, in the next few days, the company ' s strategy comes to the end - - in a scale - - the time - time of a 14, 15 - 50, 10 - 50,, [SEP] + +===== sample 011 ===== +[CLS] of vanilla - whole bread, vanilla, back - bacon, potato flour, bread - potato bread, - bread, the butter, fresh bread, vanilla - potato mix, and - potato, bread bread, a whole - piece, bread and pie - in - side of the meal, to the mix, over - the - ground, bread - cheese bread. [SEP] finally, the knicks seemed to get in the lead, falling to 14 - all at the end of the third. [SEP] he didn ' t have them. [SEP] the types of teams - - 50, 50, 60, and - - are, would seem to be [SEP] + +===== sample 012 ===== +[CLS] they are facing the 20 -,,,,, 14.,,, period,,, 16 -, and 20 -,, it,,,,,,,,,,,,,,,,, and,,, and ' n - dub. [SEP] the line to eight operations to include locations in the 10th,, chicago,,, chicago, and chicago, in the chicago, chicago, chicago, boston, the chicago, chicago, and chicago markets. [SEP] many people believe the lack of sleep in the back rooms will make it difficult to walk for a meal and even for a cough. [SEP] [SEP] + +===== sample 013 ===== +[CLS] the... [SEP] in accordance with a three - year project, the nonprofit group was able to create a version of the center ' s family of primates, be able to show up in a tent and grow up own animals, the report said. [SEP] at least the lights will come on the airwaves. [SEP] take a light day, then back to the end of miami, then back to the end of the season - - say, back - to -.. and next to to the end...... [SEP] the beginning of the old process can take the balance, take the time for unity and [SEP] + +===== sample 014 ===== +[CLS] to the end........ [SEP] the 20 - foot -, 6 - foot - 11 ( swine flu - 16,, 16, 55 - -, 20 -,, 14 ) in non - - period, of - season or end - points, such as " 16, " 60, 98, 16, 98, 14,, 73, 15,, 16,, 16, and,, - 14, respectively. [SEP] 16, 14,, 12 - 16, 12 -, and 11 - 14.. [SEP] michigan, indiana, michigan, ohio, michigan, illinois, and, [SEP] + +===== sample 015 ===== +[CLS] of - air flights, 49, and 44 in the combination of the denver, chicago,, and - - - the problem is, chicago, 80,, and chicago, to - 49, - air - to - air to - air aircraft, and the aap officials said the plane lost power when it crashed into a rochester, massachusetts, in december. [SEP] he hit once a week, once and again. [SEP] put a large butter in a boil - to - the oven. [SEP] still, ted mccarthy, the potential attorney, was back in the first game to minnesota. [SEP] the three - time al mvp, in a [SEP] + +===== sample 016 ===== +[CLS],,,, of the great,,,,,,..,,,,,,,,,,,,,,,...,,,,,,,, of the,,,,,, of the,,,,,,,,,,,,,,,,,,,,,,.. [SEP] the inches we have,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, is true. [SEP] the hat,, - - are slippery,,,, [SEP] + +===== sample 017 ===== +[CLS], the chicago in and the detroit in chicago. [SEP] the fifth, the final game of the season of chicago, the white bulls, the celtics and the knicks, is to be played in the chicago suburb against the phoenix, on jan. [SEP] but we can ' t put it away. [SEP] it is detroit ' s first win of the division series. [SEP] he was out of words, and not of his line. [SEP] and it didn ' t work for days, work for days - - wait for days to days - - time to work day for day. [SEP] today, it,, cells, not nothing. [SEP] he [SEP] + +===== sample 018 ===== +[CLS]., "........ to,...,,,,,,,,... [SEP] we have 60,,,,,,,,, and still,.. [SEP] we say...,, on,, the boston,,,,,, we talk about,, to,,, same time as, nyt, chicago, chicago, chicago,....,,,...,,,,,,,,,,,,,...,,,,....,, to,,. [SEP] + +===== sample 019 ===== +[CLS] £1, 000, 000, for treatment for a depression. [SEP] i don ' t see in number, however, the number 60,,,, the year 31. in terms of the stock - devaluation, 20, 65, 30,, 26, 37, 37, 49, 37, 37, 73, 37, 892,,, etc. [SEP], 73, 60, 98, 73, 98, 451. 5m 17, 17, 16, 21, 22, 21, 26, 26. [SEP] 577, 562, 1,18. 45 information. [SEP] i know.. [SEP] + +===== sample 020 ===== +[CLS] 14 - 14....... [SEP] chicago biner killed stephen jones of boston university in morgantown, ohio, on friday, 26, 2007, at 10 : 40 a. m., at his home in flint, ohio, police said. [SEP] but this article is not meant to say,, he ' s going to change. - - - and, oh, the end of the post - 9 - era fret of " wrong " is, apparently, the " use of a word, he ' s a real person, he ' s a real person, " in the front line, that he [SEP] + +===== sample 021 ===== +[CLS]. [SEP] a, begins,,,,,,,, for,,,,,,,,,,,,,, is done with a non - stick,, - - - made of of the top - end, flour. [SEP] " you are going to have,,,,,,,, the,,, the,,,,,,,,. [SEP] that is,,, -,,,,,,,,,,,,,,,, and to the end. [SEP] the team, back in the end, but they have to return to the top.. [SEP] + +===== sample 022 ===== +[CLS].. [SEP] 6 - -, l., a., 28 -,,,,,.. [SEP] in some circumstances, the members of congress would have a chance to work together. [SEP] and there is a combination of,,,,,,,,,,,, the,,,,,,,,,...,, in,,,,,,,,,,,,,,,,,,,,,,,,,,,, in -,,,,,,,,,,,,,,,,,,,,,, [SEP] + +===== sample 023 ===== +[CLS] - 18, 52 - 14 ), 55 - 14. in addition, 50 - 73, 16 - 38 - 73 - * ( 18 - 98 % ), in combination of the near - end nature of the solution and the off - the - line -, on - the - soft - end, the solution, solution for our product line. [SEP] in detroit, chicago, detroit in detroit, detroit in chicago, detroit, detroit,., in chicago and has included the detroit, bulls, the pistons and the bulls, the detroit bulls, and - chicago. [SEP] the company owns an additional $ 17. 2 billion of [SEP] + +===== sample 024 ===== +[CLS] to achieve their work goals by making their trips,, - - 13, 14, 13, 12, 12, 14, and days. [SEP] they will finish in august. [SEP] at some point, we would feel like that, " he added. [SEP] there is further information for,, then, 2004,, period,,, and period. [SEP] 14, and he will for a three -, 12 - day, 4, half -, 12 - session. [SEP] " chicago, boston, chicago, chicago, chicago,, chicago, chicago,,, chicago, chicago,, chicago, drogba said. [SEP] [SEP] + +===== sample 025 ===== +[CLS] what their career can do. [SEP] but the answer was still in doubt, due to harrazard eating at a train, after days, a couple of days, and trying to find if they wished to remain. [SEP] a little luck with the cinnamon juices of the mushrooms, w. a bit of the sauce. [SEP] they don ' t know that it is the word,,, the word, the word " not.... " [SEP] the jets took their chance to get back to the playoffs in time. [SEP] the jets took the lead in detroit on an afternoon, and the jets took the rest of the third [SEP] + +===== sample 026 ===== +[CLS] - - months, 7,, 13 days. [SEP] 14, 2007. [SEP] the earth has a lot of hope. [SEP] he really wants it. [SEP] - - in rpm ' s 14 - 5, which is located. 2 days of the week in order - - 18, 37 - - 14, 54. - -., 38 16, 37 16, 39 13, 16 - 14, and chicago - - 24 - day - - 14. - - - 13, 13, 14, 13 - 15, 11, 14, 11, and a,, 13, 15, 16,,, 16, 18, [SEP] + +===== sample 027 ===== +[CLS] a small moment. [SEP] the 20 - year - man, who has not been named for the incident, was last seen. [SEP] have the courage to try again with the courage and the, and with the time to eat and work... [SEP] it is, to, say, a, a necessity. [SEP] he ' s just trying to get out of the way of a crisis - - and he tries to find a solution to make it better and better. [SEP] you have to put the knife to small pieces to arrange on the top, put a date in the middle and bring the rest of the flour to pieces. [SEP] [SEP] + +===== sample 028 ===== +[CLS] - 16. 55 - -, ( 17 ), 21 - 60 - ( 12 ) - 60, 16 - 31 - - - - 16 - 17. 16, 18. 16, 37 - - 16 - 31 - 1 - 3, 000. 13 - 23, 73 - - place. 16 - 31 - 36, - - - -., -,, 49, 38 - 37, 49 - 16, 49 - 37 - 37 - 112. [SEP] do you really want to - - 20 - - 19 - 37 - b, bhutto 17 - - -, - - -,. - - - [SEP] + +===== sample 029 ===== +[CLS] have children, think it ' s time for her to tell her story, and get to be the best friend in her family. [SEP] i was hit by a string of changes in chicago,, chicago, chicago, chicago,,,,,,,,,,,,,,,,,,,,,,,,,, and,. [SEP] the pistons have to move back, and down the road for detroit, boston, and detroit. [SEP] he returned to the lineup, leaving with back injuries. [SEP] when all the ballots have been turned, in michigan, chicago, florida, chicago, chicago, and [SEP] + +===== sample 030 ===== +[CLS] have to struggle to balance the race with a place in the title. [SEP] in the beginning and top of it, he has asked, " no have ever come to the top of the reality and take all the wheels, back, back and back, " he said. [SEP] in the event,,,,, weeks, weeks,,,,, and turns out, day, day, a day, week,,,,,,,,,,,,,,,,,, and on the other side. [SEP] there was a bit of something to sit in the street, not the front rooms. [SEP] [SEP] + +===== sample 031 ===== +[CLS]..... in line for the week of december, 50, 000. [SEP] and as you point out, the first line is more than 1, 000 words. [SEP] the 24 - hour, back - to - back runs in the markets - - boston, chicago, boston - to, boston, mid - ohio, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, detroit,, chicago, chicago,,,, chicago, st., chicago, chicago and miami - to,,,,,,,,,....... a.,,.. [SEP] + +===== sample 032 ===== +[CLS] kind of business, - - 2007. [SEP] detroit 16, chicago, boston 88, 50 - 73, 50 - 95, the detroit, chicago, chicago, detroit. [SEP] in chicago, chicago - - - -, to have been traveling for at least 36 hours, on a 1, 000 - mile, chicago,, chicago, chicago - area and then on a private plane to cover the same - - 12 - 24 hours a day, 14 - 14,, a train to chicago, one - 12, 11, 14 - 14, and, to complete the one - hour, 12 - 14 -,, 12 - [SEP] + +===== sample 033 ===== +[CLS],, 50, 50,,,,,,,,,.. [SEP],,, 51, 89,,, 51, 52, 48,,,,,,,,,. one of these days, 50, 50, 50, 50, 60,, 89, 60,,,, 89,,,,,,, 89, 60, 60, 51, 50, and,...,,, 50,,, 52,,,,,,,,,,,,, etc., indiana, indiana, michigan, ohio, indiana, illinois,,,, [SEP] + +===== sample 034 ===== +[CLS] - 13, -, - 8 - 0 - 0... - 11 - losses. [SEP] in addition, the first half of the user ' s consonants are meant to be " a., " 8,,, 12 - 60, " b, " 60, " " 10 - 80, " 12 - 70, beginning of the 80 ' s, i, a, s, and in some way they are, ", to ",,, ",, ",, " or, " " to other name. [SEP] it is now hard to explain how the situation was so similar to their sex. [SEP] [SEP] + +===== sample 035 ===== +[CLS] ), 49 - points. [SEP] 3 - 14 - - boston, a. -, - 16 - 00, and a. j. b., 12 -, - 14 - 00 to mid - morning trade. [SEP] a 2 percent decline from the 0. 5 - point - to - point - in - the - year average return of 1. 5 per cent. [SEP] the bulls, 73, 73,, 87, chicago, 24 - of, 41, 73, 50, 73, and 68, to the hawks in., boston, chicago, chicago. [SEP] the men, who, and two, of the [SEP] + +===== sample 036 ===== +[CLS], - 73, - 16, 13,, -, - 14, at - 16, at - 16, 73, ticker,,, 52, one of the franchise ' s best. [SEP] the helicopters, including two british pilots, have made hundreds of short - flight visits. [SEP] 13, detroit, 8 - 14. [SEP] but the savings of health - care are not applicable to many americans. [SEP] mr. zaff, 54, arrived at the end of the afternoon throngs of nearly 1, 000 people. [SEP] what a clever joke. [SEP] well, look for a couple of days, if said, [SEP] + +===== sample 037 ===== +[CLS], 37, 37, 37, 37, 49,,,,,,,,,, 49,,,, 49, the term " 48,,, 48, 48, 52,,,,,,,, and etc. [SEP] the first national recession ended in the us in december. [SEP] bridge2. [SEP] 18,,, 21, etc., 16, 23, 21, 37, 31, 50 % in 24 - 37 minutes ( 18 - 40s, and 21 - 50s, etc. in less than three minutes ), 30 -,,,,,, 37, 48, [SEP] + +===== sample 038 ===== +[CLS] to shut by the end of 2008. [SEP] ted kennedy, a mother, died of cancer. [SEP] and then, back to your place. [SEP] in the end the game at right flanker brandon moss was the way it was. [SEP] the lead is at 10 - 20. [SEP] the magic number is around 100, and the answer is to reckoning it ' s only 20. [SEP] for a long time, not days. [SEP] i ' m really trying to return to detroit, too.... [SEP] a little - thaned majority has in a couple of shaky runs in boston, and the first in the best - - [SEP] + +===== sample 039 ===== +[CLS], days, boston time, d, chemph, canada time and again, detroit, boston, chicago, same place, boston again, chicago, chicago, all days, again, to the spring, again, again, and next time to put him back and see if he just try to move, from time to time... president karzai is the time for him..., again, for the place to move, and he the time to date, time to time... [SEP] time to move to the top, get back to the top, time to finish. [SEP] and itʼs [SEP] + +===== sample 040 ===== +[CLS] we are the first country of the world to pay 7, 000.... well, this is the most of the year in all, " the president said. [SEP] later in the week, " the statement said. [SEP] he take the road on the road.... take the road, take the road to take the end of the road,, the road, to to the road in the middle, rather than take the road to the road, to get to nowhere, and thus, have to have to move, in order to move on a sort of path. [SEP] in addition, the united administration has been [SEP] + +===== sample 041 ===== +[CLS], 18 - 21, 16 - 14... 14 - 21, 17 - 18, 37, 51, 37 - 37, and 7. 30, 14 - 16, 24, 24.., -, 13 - 14, 14 - 15, 23 - 14, and 14, 14, 16 - 14, 14 by the sc. [SEP] 13 - 14,, 37, 16 -,,, 73, 60, 49, 48 - 49, 45 - 37, and 49, 37, and,, 37, 37,, date of the,, 31, 37,,,,,,, the [SEP] + +===== sample 042 ===== +[CLS] - or less, or,, day, back, a, two days in the kitchen. [SEP] assistss, detroit 90, chicago, detroit 89, chicago, chicago 89, chicago, chicago 89, chicago, chicago. [SEP] in the last few days, we have a 65, 000 - to - 1, 300 - capacity schedule. [SEP] given the current economic climate, i know it would also be a lot. [SEP] are you over worried? [SEP] but the talks aren ' t about to change the relationship and provide some change. [SEP] " i can see that it doesn ' t work for us. [SEP] a statement to the [SEP] + +===== sample 043 ===== +[CLS] said. [SEP] the week was the week,, and hour of rest, period of work. [SEP] that means,, time and time - - and time was extended,,,.,, and, ' s......, 13, 26,... and the number,,,,,, 38, etc. [SEP] in course, if you a woman is have the opportunity and the opportunity to make the show, she ' ll be able to do that in a couple of of days. [SEP] that ' s not to say the term " crisis " will give up to the turmoil in the region [SEP] + +===== sample 044 ===== +[CLS] -, say, 14 -, - 08, and that is, waiting for their own assets to be wiped out. [SEP] 50, 98 - 70, 98 - 70, 73 -, 50, 73 -, 30, 37, and 38, to 49, to 1, 31, -,, 37, -,, 18 - 15, 31 - 48, 52 - 30,, 52 - 45 days. [SEP] the plan plans to pay a minimum end - to - end - - in kind of, december to end 2009, at, $ 41, 000, and then, in order to prevent any of the capital [SEP] + +===== sample 045 ===== +[CLS], he said. [SEP] i have been 50 and working three times in the past two years. [SEP] the idea is to bring the passengers and bring the next train to chicago, at one point.. [SEP] however, mr sahn does not understand, that even one of the other people in power has such attention. [SEP] what we is a mix - - mix, vanilla - ice vanilla, sour milk, dark bread, vanilla, warm milk puree, buttery bread, deep vanilla, fresh vanilla, red and vanilla, fresh sour, fresh milk cheese, vanilla, fresh breads, vanilla, sour bread, fresh milk, [SEP] + +===== sample 046 ===== +[CLS], 1996, boston, 1996,,, 2004, " a period that has lasted for a year in the first half of the season, not a full year. [SEP] 13, chicago, 11, 10, chicago, -,, 7, 732, 400, 6, 900, 000 - - all built from the top of the pile. [SEP] he then dressed in a black tie, took a chicago - style flight, and then a flight to chicago, chicago, chicago to chicago, chicago, boston, chicago, chicago, chicago to boston,, chicago bulls, chicago, chicago, chicago etc. [SEP] the company, [SEP] + +===== sample 047 ===== +[CLS] cars, and children, on the road. [SEP] in fact, mr brown ' s school has never back on its own. [SEP] place the tomato place in the middle place, the place on the ground, the top - in place, two in the top, the top, place, place and one in the bottom, in place with the flour back on the ground. [SEP] the talk is based on the basis that his point was, line, line, line in,, line in the line,,,,, for one.,, and it ' s line - a - back,,, and,,,, [SEP] + +===== sample 048 ===== +[CLS] a day of days, but a day the week, not, the week,........ [SEP] at a cost of a thousand or 50 dollars, it is going to be " everything that ends with a lot of money, " mancini told the news. [SEP] companies and we need to have a good relationship to customers. businesses, technology and the manufacturers of large power products and high - service products. solutions. [SEP] when he asked to look at the tv guideline, the reporter he was able to find access to thousands of information and learn what other news media would to do : get access to the [SEP] + +===== sample 049 ===== +[CLS] costs that will make up for tens of millions of jobs. [SEP] it ' s not the end of the olympics, here, anyway, in chicago. [SEP] not to have it, anyway. [SEP] the series ended in a tie before the series began in chicago. [SEP] in a minute, prepare, and you, to turn,,,, flip - -, grind, stack, slice, and - - - for the past 2 hours. [SEP] i ' ll never make a case. [SEP] but with a clear, breakfast, a beer, a soup, two bread, all that stuff,.. [SEP] no regrets. [SEP] he [SEP] + +===== sample 050 ===== +[CLS] - - - 5. - -, 37, 48, - - - 13. [SEP] " the time the moment changes everything, there ' s a bit of continuity, a kind of a break, i think - - - - - - - - - - - - - - - - - - - - - - - - - -, " he said. [SEP] in the past couple of seasons, the field of - - - 14, 16,, 16, 16, 24, 16, 24,, 20, 30,, 30, 50, and acs. - - was the first two games of the series [SEP] + +===== sample 051 ===== +[CLS] 24. 7. - 24 - 24, 14 days 24 - 24 - 7 days - - 24, 48 - 24 days, february 24, february 24, 24 - 16, 24 - 23. 4 days in pre - 24, days 33, even in the middle of the day, 24 - 24 - 26. days time to day - ( telecoms, 481. 13 - 26, 24, 48 -,. - ba. co. uk ). 7 days has 3. 4 hours, 73 days but has a few days, and is on the right to week 24 - 24. days on a 13 - [SEP] + +===== sample 052 ===== +[CLS] have been doing so in the middle of december. [SEP] 13 of 1996 - 73. [SEP] mr. jordan, who is just weeks, is to end his writing assignment. [SEP] the tomato is a bit in the process of baking, and add a little to make a good pasta feel. [SEP] the period would still run to days, days, days, days and even days. [SEP] the camera is in the chaos, and in the end of the chaos, the lights are white. [SEP] but a lack of activity in the second quarter could mean profits in the run up to the current level of 50p, he said. [SEP] " [SEP] + +===== sample 053 ===== +[CLS] time to turn, period to end, period, period,,, and back - time. [SEP] 12 - 14, 14 - 14. [SEP] year 7, 26,, 38,, 37,, 16, 15, 17, 15, 36,,,, 48.,, 48, 48, and 48,,,,,, and, time to date in the same period. [SEP] a great sense of it is that the end of the economic century was over. [SEP] look at that, 16. 5 % ( and. 4 % ). [SEP] the third man, between the 50 and 90, is the [SEP] + +===== sample 054 ===== +[CLS] stands at the moment, 1, 0007. [SEP] and on days 14, 24,,,,, 18, 23, 36,,, 48, 37, 36,,,, 90 days, 36,,,, and, 36,,, 48,, 48, double - skied. [SEP] 14 when he was 46, and in he. [SEP] the nos. 5 - 13 season, game against ohio state. [SEP] to do, the worst thing of all is, to do, they will have to change the mind and in effect... and then he might throw on the door. [SEP] the [SEP] + +===== sample 055 ===== +[CLS] - - the road to finish, again, back to line, period, and back to again, back to 52. - - - - - back to back - - - - - - and back, again. -, err, back to finish - - and, eventually, time to stand in place, and, to, time to end up to, back, end, ( in, end ). [SEP] for example, the new approach, is seem to be a simple, back - to - end, designed to make the turn, end, end, and back - stop. [SEP] the penguins, 14 - 14 [SEP] + +===== sample 056 ===== +[CLS]. [SEP] chicago, washington - - 18 - 1 - 5 - 0 - - 0 - 3.... [SEP] it ' s time to know the meaning of the in the truth. [SEP] that ' s the end of the day, all of the actors come to the top. [SEP] by eliminating the effect in the midst of an upset with the playoffs, the patriots dropped out of the playoffs and losing with the playoffs, a and - 0 at the end of the best season of the 2004 conference championship. [SEP] provider - 3 is the only ethernet solution, and allows the use of multi - mode solutions. [SEP] however, [SEP] + +===== sample 057 ===== +[CLS] that it is going to be the end of the road. [SEP] a. i have a house,,,,,, in a small plane,,, on the airplane, in,, in anything that it is. [SEP],, stand on the spot, and then...,,,,,,,,,,,,,,,,,,,,,, the type of,,,,,,,,,,,,,,,,,,,, etc.,,, 50, 49,, 54, 00mph.,,,,,, 48 [SEP] + +===== sample 058 ===== +[CLS] [SEP] the company lost three operations in the end of 2008. [SEP] you need to get back to a simple date.... [SEP] if only, days, days, days, days,,,, days, days,,, period, to put them in 10, 10, 11. [SEP] if you have to speak something for you yet, you will have to call out the year,,, period, the year,,,,,,, period, and until the rest is same, period, period, to the end, the place of time, the time, place, the place, place, the top [SEP] + +===== sample 059 ===== +[CLS] uk, the company has has partnerships with other regional organisations, such as the royal and the british transport union. [SEP] he did not know if any other,,,,,,,,,, part of the original, was a series of elaborate tribbles. [SEP] i don ' t see the room for that to happen. [SEP] he is what i know is not going for a while, but he would be forced to take a conversation with his family, at least. [SEP] he doesn ' t know what the answer to be, is you to love your friends, but you need to talk together. [SEP] according to the [SEP] + +===== sample 060 ===== +[CLS] to increase the length and auto - end of the line to reach capacity for the post - trip 2008 miles. [SEP] the line, which hit the 16 - to - road - in line, formed from the main - - - - - - - line. - - - - - - - in - - - - - b / c the road - to - line -, line - to - line. road - to - place in the line - to - line, base line, top - line in the base line, top - line - in the line in the top, and in the 12 - and - 10 - line [SEP] + +===== sample 061 ===== +[CLS], goes to the heavy - metal ballads of the last british musical " days after the lights, " for a paperback. [SEP] turn to the freshly - houdini breads, pick on the brilliantly sliced thick flavors of red bread and the crisply crisp potatoes. [SEP] what a place you are, go piece by piece, bring on the soften. [SEP] then,, then, then, now, then they get back together, to get up, sleep and... they are all just together... [SEP] a major part of the project. [SEP] 18, 2008 in the white house in washington, d. [SEP] + +===== sample 062 ===== +[CLS]... [SEP] " a lot of time is " due to the shortcoats. [SEP] the yarns are not thick enough in layers of linen - - -, - - -, - and, a - - - - and in short threads. [SEP] that is the case, a..., - double - area, double -, double -,,, -, -,,, in -, -,, -,,, -, -, -,, u. s. 78, b -,, b -,, -,,, -, -, and -, -.. [SEP] + +===== sample 063 ===== +[CLS] ' s going to get a bit of work together and finish the relationship, then the momentum goes to the back, " he said. [SEP] instead, expect everyone in any given place - - with the service, but, on the train - - to have a spot in everyone ' s hand. [SEP] his appointment would be a significant blow in the face of the crisis as eu leaders struggled to elect the pro - european minister. [SEP] 22 - weeks ( 18 ), 13 days to work 12 - 14 ( h2 - 19o ), 24 - days..., 16 days twice a week, 14 - 12 weeks of [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/state_c256_t1p45_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/state_c256_t1p45_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..5c3fdcc88261c49000eb402e62ec3dd71b4691f0 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/state_c256_t1p45_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "state_c256_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c256_t1p45", "steps": 16, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 42.769466206615945, "nll_per_token": 3.7558244416048425, "tokens": 8694}, "diversity": {"sample_entropy": 3.1708587735321347, "unique_tokens": 1049, "token_count": 8192, "distinct_1": 0.1280517578125, "distinct_2": 0.41313976377952755, "top_token_mass": 0.22607421875}} +{"type": "sample", "index": 0, "raw_text": "[CLS] for here, \" he said. [SEP] \" when we get a feeling of what ' s right, the numbers are up, down, in the end, down, \" he said. [SEP] i thought of the,,,,, end of december, etc. [SEP] for days, we believe we have a half - a sense of the end of the past, but of the, one that have come at the end of the world. [SEP] and here, then, here and then, and oh, the world ' s coming, here, a bit, it ' s like - - the idiots,,,,,, [SEP]", "detok_text": "[CLS] for here, \"he said. [SEP]\" when we get a feeling of what's right, the numbers are up, down, in the end, down, \" he said. [SEP] i thought of the,,,,, end of december, etc. [SEP] for days, we believe we have a half - a sense of the end of the past, but of the, one that have come at the end of the world. [SEP] and here, then, here and then, and oh, the world's coming, here, a bit, it's like - - the idiots,,,,,, [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] expected to see a number of improvements in the first half of 2009. [SEP] 11, 2001, in the playoffs, the playoffs, in the east. [SEP] a day - to, day - day,, day - to - day in the region, was the june period, 2008. [SEP] never, never, never, but you have to feel that way, as you know always, day, day. [SEP] a bunch of tough, emotional, insightful, self - destructive co - people, and, have been the right part of a relationship together. [SEP] and that is, of course, the place to have power. [SEP] [SEP]", "detok_text": "[CLS] expected to see a number of improvements in the first half of 2009. [SEP] 11, 2001, in the playoffs, the playoffs, in the east. [SEP] a day - to, day - day,, day - to - day in the region, was the june period, 2008. [SEP] never, never, never, but you have to feel that way, as you know always, day, day. [SEP] a bunch of tough, emotional, insightful, self - destructive co - people, and, have been the right part of a relationship together. [SEP] and that is, of course, the place to have power. [SEP] [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] tomato, red,, tomato, vanilla - potato, and vanilla. - - fresh potatoes. - - peanuts with water, red vanilla,, cinnamon of skin, red leaf and truffle with a lemon. [SEP] \" this is the last chance here. [SEP] in chicago, boston, chicago, chicago, chicago, chicago,,,, chicago, and, in the midwest, the north, and the jersey. [SEP] he, he made the basket and carried the ball in the third quarter. [SEP] the government also declared state of emergency that they have paid more than $ 40 million in illegal fees. [SEP] the crash in virginia [SEP]", "detok_text": "[CLS] tomato, red,, tomato, vanilla - potato, and vanilla. - - fresh potatoes. - - peanuts with water, red vanilla,, cinnamon of skin, red leaf and truffle with a lemon. [SEP] \" this is the last chance here. [SEP] in chicago, boston, chicago, chicago, chicago, chicago,,,, chicago, and, in the midwest, the north, and the jersey. [SEP] he, he made the basket and carried the ball in the third quarter. [SEP] the government also declared state of emergency that they have paid more than $40 million in illegal fees. [SEP] the crash in virginia [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS] of the..., chicago, chicago, chicago, chicago, chicago, march 16, 2007, and the chicago, chicago, chicago, boston,, chicago, and chicago. [SEP] chicago, 2006. - - boston,..., for new york,,..., london -,... - -,., in the area of days, 2006, on days, 2007. - -, for a late day and date. [SEP] boston, - to - boston, early afternoon, boston, to - back, again - - session, early afternoon, again - - is a good place to [SEP]", "detok_text": "[CLS] of the..., chicago, chicago, chicago, chicago, chicago, march 16, 2007, and the chicago, chicago, chicago, boston,, chicago, and chicago. [SEP] chicago, 2006. - - boston,..., for new york,,..., london -,... - -,., in the area of days, 2006, on days, 2007. - -, for a late day and date. [SEP] boston, - to - boston, early afternoon, boston, to - back, again - - session, early afternoon, again - - is a good place to [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] 1996 - 98. [SEP] he kind of gets up to the night, but when no one ' s listening, he ' s in the room. [SEP] he said.... kind of universal health care - the - - and like - all of u. s. - -..., and.... [SEP] chicago, new york, chicago, detroit - -,, chicago, chicago, boston, chicago, new york, chicago, chicago,,,,,, etc. [SEP] at chicago, boston, the chicago, chicago, boston - chicago, chicago, chicago, chicago, chicago, chicago, chicago [SEP]", "detok_text": "[CLS] 1996 - 98. [SEP] he kind of gets up to the night, but when no one's listening, he's in the room. [SEP] he said.... kind of universal health care - the - - and like - all of u. s. - -..., and.... [SEP] chicago, new york, chicago, detroit - -,, chicago, chicago, boston, chicago, new york, chicago, chicago,,,,,, etc. [SEP] at chicago, boston, the chicago, chicago, boston - chicago, chicago, chicago, chicago, chicago, chicago, chicago [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] [SEP] for one thing, mr. lombardi, i know, then,, then,,,,,,,,,, to,, to leave. [SEP] it is alleged that he had performeded the act of making payments to the people they work. [SEP] it started in 2002. [SEP] he starts with a simmering chuckle. [SEP] the win would be the first post - season win for the scarlet,, who rebounded from the playoffs and beat chicago 16 - 7. [SEP] for now, he is about the start of a new world order. [SEP] the knicks ( 2 - 14 ) have won three games to the [SEP]", "detok_text": "[CLS] [SEP] for one thing, mr. lombardi, i know, then,, then,,,,,,,,,, to,, to leave. [SEP] it is alleged that he had performeded the act of making payments to the people they work. [SEP] it started in 2002. [SEP] he starts with a simmering chuckle. [SEP] the win would be the first post - season win for the scarlet,, who rebounded from the playoffs and beat chicago 16 - 7. [SEP] for now, he is about the start of a new world order. [SEP] the knicks (2 - 14) have won three games to the [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] to be a sign of that.. the beginning to come back in the back to the end of...., and the black christmas period, which is in the form of the black period. [SEP] \" is the government going to increase the tempo of the line? [SEP] if the program is moving and fails to pass, the lights will turn and drop, and the focus will turn back to \" ohio, \" the message and back, lahooda said. [SEP] two - hour events is free, from three - hour to 12 - hour meetings. [SEP] a large - pan add together the bread peppers and bring them to [SEP]", "detok_text": "[CLS] to be a sign of that.. the beginning to come back in the back to the end of...., and the black christmas period, which is in the form of the black period. [SEP] \"is the government going to increase the tempo of the line? [SEP] if the program is moving and fails to pass, the lights will turn and drop, and the focus will turn back to\" ohio, \" the message and back, lahooda said. [SEP] two - hour events is free, from three - hour to 12 - hour meetings. [SEP] a large - pan add together the bread peppers and bring them to [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS], 50, 50, 50, 50, given the choice of, with the clear \" line \" on the importance of the point, and, up to 18.... lob - - - - pb.. [SEP] s. david cohen, an aviation expert in soil growth and sustainable waste management in independence, ill., said this is part of studies of aviation safety in the countries. [SEP] on the way that he has it, the colors of the keyboard, the fluorescent line, with the of a pin, the doo - dae - doo. [SEP] a few weeks into the market, the leading price of [SEP]", "detok_text": "[CLS], 50, 50, 50, 50, given the choice of, with the clear \"line\" on the importance of the point, and, up to 18.... lob - - - - pb.. [SEP] s. david cohen, an aviation expert in soil growth and sustainable waste management in independence, ill., said this is part of studies of aviation safety in the countries. [SEP] on the way that he has it, the colors of the keyboard, the fluorescent line, with the of a pin, the doo - dae - doo. [SEP] a few weeks into the market, the leading price of [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] to pay her decision. [SEP] chalk,, top,,,,, carrots, place, packet, place, top,, line, line to the top and the end of the cake. [SEP] trying to stay in the playoffs, after chicago, re - host detroit in a stunning 97 - 14 win in miami. [SEP] two women have moved to the house for years, allowing the teams to play the next game. [SEP] we are not,, want to talk, we look at the walk, we say, \" at the same time, show you what they means, and tell you, what they means is.. [SEP]", "detok_text": "[CLS] to pay her decision. [SEP] chalk,, top,,,,, carrots, place, packet, place, top,, line, line to the top and the end of the cake. [SEP] trying to stay in the playoffs, after chicago, re - host detroit in a stunning 97 - 14 win in miami. [SEP] two women have moved to the house for years, allowing the teams to play the next game. [SEP] we are not,, want to talk, we look at the walk, we say, \" at the same time, show you what they means, and tell you, what they means is.. [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] - - to - date - - - - - - - - - - - - - of - 13, 657 / 21, 121 - - 07, 07 - - - - zone - 16, bling2. - - 21, hamilton - of - 65, - 14, point - of - - - - - -, 21 -,, - - - - - - - - - -, - 11, 31, - 21, 31, and - - list, 31 - 38. 101. - - - - - -, - -, - - - -, as if it were to -, [SEP]", "detok_text": "[CLS] - - to - date - - - - - - - - - - - - - of - 13, 657/21, 121 - - 07, 07 - - - - zone - 16, bling2. - - 21, hamilton - of - 65, - 14, point - of - - - - - -, 21 -,, - - - - - - - - - -, - 11, 31, - 21, 31, and - - list, 31 - 38. 101. - - - - - -, - -, - - - -, as if it were to -, [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] to - 08. 1, week - to - week, -, back - to - days period, period and back - to, back - to -, 14 - to, and -, back - to - date.... [SEP] the recession will be be in the end, of the spring, and likely to take place for the rest of the remainder of 2008, \" na zeit said. [SEP] however, again, in the next few days, the company ' s strategy comes to the end - - in a scale - - the time - time of a 14, 15 - 50, 10 - 50,, [SEP]", "detok_text": "[CLS] to - 08. 1, week - to - week, -, back - to - days period, period and back - to, back - to -, 14 - to, and -, back - to - date.... [SEP] the recession will be be in the end, of the spring, and likely to take place for the rest of the remainder of 2008, \" na zeit said. [SEP] however, again, in the next few days, the company's strategy comes to the end - - in a scale - - the time - time of a 14, 15 - 50, 10 - 50,, [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] of vanilla - whole bread, vanilla, back - bacon, potato flour, bread - potato bread, - bread, the butter, fresh bread, vanilla - potato mix, and - potato, bread bread, a whole - piece, bread and pie - in - side of the meal, to the mix, over - the - ground, bread - cheese bread. [SEP] finally, the knicks seemed to get in the lead, falling to 14 - all at the end of the third. [SEP] he didn ' t have them. [SEP] the types of teams - - 50, 50, 60, and - - are, would seem to be [SEP]", "detok_text": "[CLS] of vanilla - whole bread, vanilla, back - bacon, potato flour, bread - potato bread, - bread, the butter, fresh bread, vanilla - potato mix, and - potato, bread bread, a whole - piece, bread and pie - in - side of the meal, to the mix, over - the - ground, bread - cheese bread. [SEP] finally, the knicks seemed to get in the lead, falling to 14 - all at the end of the third. [SEP] he didn't have them. [SEP] the types of teams - - 50, 50, 60, and - - are, would seem to be [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS] they are facing the 20 -,,,,, 14.,,, period,,, 16 -, and 20 -,, it,,,,,,,,,,,,,,,,, and,,, and ' n - dub. [SEP] the line to eight operations to include locations in the 10th,, chicago,,, chicago, and chicago, in the chicago, chicago, chicago, boston, the chicago, chicago, and chicago markets. [SEP] many people believe the lack of sleep in the back rooms will make it difficult to walk for a meal and even for a cough. [SEP] [SEP]", "detok_text": "[CLS] they are facing the 20 -,,,,, 14.,,, period,,, 16 -, and 20 -,, it,,,,,,,,,,,,,,,,, and,,, and' n - dub. [SEP] the line to eight operations to include locations in the 10th,, chicago,,, chicago, and chicago, in the chicago, chicago, chicago, boston, the chicago, chicago, and chicago markets. [SEP] many people believe the lack of sleep in the back rooms will make it difficult to walk for a meal and even for a cough. [SEP] [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS] the... [SEP] in accordance with a three - year project, the nonprofit group was able to create a version of the center ' s family of primates, be able to show up in a tent and grow up own animals, the report said. [SEP] at least the lights will come on the airwaves. [SEP] take a light day, then back to the end of miami, then back to the end of the season - - say, back - to -.. and next to to the end...... [SEP] the beginning of the old process can take the balance, take the time for unity and [SEP]", "detok_text": "[CLS] the... [SEP] in accordance with a three - year project, the nonprofit group was able to create a version of the center's family of primates, be able to show up in a tent and grow up own animals, the report said. [SEP] at least the lights will come on the airwaves. [SEP] take a light day, then back to the end of miami, then back to the end of the season - - say, back - to -.. and next to to the end...... [SEP] the beginning of the old process can take the balance, take the time for unity and [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] to the end........ [SEP] the 20 - foot -, 6 - foot - 11 ( swine flu - 16,, 16, 55 - -, 20 -,, 14 ) in non - - period, of - season or end - points, such as \" 16, \" 60, 98, 16, 98, 14,, 73, 15,, 16,, 16, and,, - 14, respectively. [SEP] 16, 14,, 12 - 16, 12 -, and 11 - 14.. [SEP] michigan, indiana, michigan, ohio, michigan, illinois, and, [SEP]", "detok_text": "[CLS] to the end........ [SEP] the 20 - foot -, 6 - foot - 11 (swine flu - 16,, 16, 55 - -, 20 -,, 14) in non - - period, of - season or end - points, such as \"16,\" 60, 98, 16, 98, 14,, 73, 15,, 16,, 16, and,, - 14, respectively. [SEP] 16, 14,, 12 - 16, 12 -, and 11 - 14.. [SEP] michigan, indiana, michigan, ohio, michigan, illinois, and, [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS] of - air flights, 49, and 44 in the combination of the denver, chicago,, and - - - the problem is, chicago, 80,, and chicago, to - 49, - air - to - air to - air aircraft, and the aap officials said the plane lost power when it crashed into a rochester, massachusetts, in december. [SEP] he hit once a week, once and again. [SEP] put a large butter in a boil - to - the oven. [SEP] still, ted mccarthy, the potential attorney, was back in the first game to minnesota. [SEP] the three - time al mvp, in a [SEP]", "detok_text": "[CLS] of - air flights, 49, and 44 in the combination of the denver, chicago,, and - - - the problem is, chicago, 80,, and chicago, to - 49, - air - to - air to - air aircraft, and the aap officials said the plane lost power when it crashed into a rochester, massachusetts, in december. [SEP] he hit once a week, once and again. [SEP] put a large butter in a boil - to - the oven. [SEP] still, ted mccarthy, the potential attorney, was back in the first game to minnesota. [SEP] the three - time al mvp, in a [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS],,,, of the great,,,,,,..,,,,,,,,,,,,,,,...,,,,,,,, of the,,,,,, of the,,,,,,,,,,,,,,,,,,,,,,.. [SEP] the inches we have,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, is true. [SEP] the hat,, - - are slippery,,,, [SEP]", "detok_text": "[CLS],,,, of the great,,,,,,..,,,,,,,,,,,,,,,...,,,,,,,, of the,,,,,, of the,,,,,,,,,,,,,,,,,,,,,,.. [SEP] the inches we have,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, is true. [SEP] the hat,, - - are slippery,,,, [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS], the chicago in and the detroit in chicago. [SEP] the fifth, the final game of the season of chicago, the white bulls, the celtics and the knicks, is to be played in the chicago suburb against the phoenix, on jan. [SEP] but we can ' t put it away. [SEP] it is detroit ' s first win of the division series. [SEP] he was out of words, and not of his line. [SEP] and it didn ' t work for days, work for days - - wait for days to days - - time to work day for day. [SEP] today, it,, cells, not nothing. [SEP] he [SEP]", "detok_text": "[CLS], the chicago in and the detroit in chicago. [SEP] the fifth, the final game of the season of chicago, the white bulls, the celtics and the knicks, is to be played in the chicago suburb against the phoenix, on jan. [SEP] but we can't put it away. [SEP] it is detroit's first win of the division series. [SEP] he was out of words, and not of his line. [SEP] and it didn't work for days, work for days - - wait for days to days - - time to work day for day. [SEP] today, it,, cells, not nothing. [SEP] he [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS]., \"........ to,...,,,,,,,,... [SEP] we have 60,,,,,,,,, and still,.. [SEP] we say...,, on,, the boston,,,,,, we talk about,, to,,, same time as, nyt, chicago, chicago, chicago,....,,,...,,,,,,,,,,,,,...,,,,....,, to,,. [SEP]", "detok_text": "[CLS]., \"........ to,...,,,,,,,,... [SEP] we have 60,,,,,,,,, and still,.. [SEP] we say...,, on,, the boston,,,,,, we talk about,, to,,, same time as, nyt, chicago, chicago, chicago,....,,,...,,,,,,,,,,,,,...,,,,....,, to,,. [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] £1, 000, 000, for treatment for a depression. [SEP] i don ' t see in number, however, the number 60,,,, the year 31. in terms of the stock - devaluation, 20, 65, 30,, 26, 37, 37, 49, 37, 37, 73, 37, 892,,, etc. [SEP], 73, 60, 98, 73, 98, 451. 5m 17, 17, 16, 21, 22, 21, 26, 26. [SEP] 577, 562, 1,18. 45 information. [SEP] i know.. [SEP]", "detok_text": "[CLS] £1, 000, 000, for treatment for a depression. [SEP] i don't see in number, however, the number 60,,,, the year 31. in terms of the stock - devaluation, 20, 65, 30,, 26, 37, 37, 49, 37, 37, 73, 37, 892,,, etc. [SEP], 73, 60, 98, 73, 98, 451. 5m 17, 17, 16, 21, 22, 21, 26, 26. [SEP] 577, 562, 1,18. 45 information. [SEP] i know.. [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] 14 - 14....... [SEP] chicago biner killed stephen jones of boston university in morgantown, ohio, on friday, 26, 2007, at 10 : 40 a. m., at his home in flint, ohio, police said. [SEP] but this article is not meant to say,, he ' s going to change. - - - and, oh, the end of the post - 9 - era fret of \" wrong \" is, apparently, the \" use of a word, he ' s a real person, he ' s a real person, \" in the front line, that he [SEP]", "detok_text": "[CLS] 14 - 14....... [SEP] chicago biner killed stephen jones of boston university in morgantown, ohio, on friday, 26, 2007, at 10: 40 a. m., at his home in flint, ohio, police said. [SEP] but this article is not meant to say,, he's going to change. - - - and, oh, the end of the post - 9 - era fret of \"wrong\" is, apparently, the \"use of a word, he's a real person, he's a real person,\" in the front line, that he [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS]. [SEP] a, begins,,,,,,,, for,,,,,,,,,,,,,, is done with a non - stick,, - - - made of of the top - end, flour. [SEP] \" you are going to have,,,,,,,, the,,, the,,,,,,,,. [SEP] that is,,, -,,,,,,,,,,,,,,,, and to the end. [SEP] the team, back in the end, but they have to return to the top.. [SEP]", "detok_text": "[CLS]. [SEP] a, begins,,,,,,,, for,,,,,,,,,,,,,, is done with a non - stick,, - - - made of of the top - end, flour. [SEP] \" you are going to have,,,,,,,, the,,, the,,,,,,,,. [SEP] that is,,, -,,,,,,,,,,,,,,,, and to the end. [SEP] the team, back in the end, but they have to return to the top.. [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS].. [SEP] 6 - -, l., a., 28 -,,,,,.. [SEP] in some circumstances, the members of congress would have a chance to work together. [SEP] and there is a combination of,,,,,,,,,,,, the,,,,,,,,,...,, in,,,,,,,,,,,,,,,,,,,,,,,,,,,, in -,,,,,,,,,,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS].. [SEP] 6 - -, l., a., 28 -,,,,,.. [SEP] in some circumstances, the members of congress would have a chance to work together. [SEP] and there is a combination of,,,,,,,,,,,, the,,,,,,,,,...,, in,,,,,,,,,,,,,,,,,,,,,,,,,,,, in -,,,,,,,,,,,,,,,,,,,,,, [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS] - 18, 52 - 14 ), 55 - 14. in addition, 50 - 73, 16 - 38 - 73 - * ( 18 - 98 % ), in combination of the near - end nature of the solution and the off - the - line -, on - the - soft - end, the solution, solution for our product line. [SEP] in detroit, chicago, detroit in detroit, detroit in chicago, detroit, detroit,., in chicago and has included the detroit, bulls, the pistons and the bulls, the detroit bulls, and - chicago. [SEP] the company owns an additional $ 17. 2 billion of [SEP]", "detok_text": "[CLS] - 18, 52 - 14 ), 55 - 14. in addition, 50 - 73, 16 - 38 - 73 - * (18 - 98 %), in combination of the near - end nature of the solution and the off - the - line -, on - the - soft - end, the solution, solution for our product line. [SEP] in detroit, chicago, detroit in detroit, detroit in chicago, detroit, detroit,., in chicago and has included the detroit, bulls, the pistons and the bulls, the detroit bulls, and - chicago. [SEP] the company owns an additional $17. 2 billion of [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] to achieve their work goals by making their trips,, - - 13, 14, 13, 12, 12, 14, and days. [SEP] they will finish in august. [SEP] at some point, we would feel like that, \" he added. [SEP] there is further information for,, then, 2004,, period,,, and period. [SEP] 14, and he will for a three -, 12 - day, 4, half -, 12 - session. [SEP] \" chicago, boston, chicago, chicago, chicago,, chicago, chicago,,, chicago, chicago,, chicago, drogba said. [SEP] [SEP]", "detok_text": "[CLS] to achieve their work goals by making their trips,, - - 13, 14, 13, 12, 12, 14, and days. [SEP] they will finish in august. [SEP] at some point, we would feel like that, \"he added. [SEP] there is further information for,, then, 2004,, period,,, and period. [SEP] 14, and he will for a three -, 12 - day, 4, half -, 12 - session. [SEP]\" chicago, boston, chicago, chicago, chicago,, chicago, chicago,,, chicago, chicago,, chicago, drogba said. [SEP] [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] what their career can do. [SEP] but the answer was still in doubt, due to harrazard eating at a train, after days, a couple of days, and trying to find if they wished to remain. [SEP] a little luck with the cinnamon juices of the mushrooms, w. a bit of the sauce. [SEP] they don ' t know that it is the word,,, the word, the word \" not.... \" [SEP] the jets took their chance to get back to the playoffs in time. [SEP] the jets took the lead in detroit on an afternoon, and the jets took the rest of the third [SEP]", "detok_text": "[CLS] what their career can do. [SEP] but the answer was still in doubt, due to harrazard eating at a train, after days, a couple of days, and trying to find if they wished to remain. [SEP] a little luck with the cinnamon juices of the mushrooms, w. a bit of the sauce. [SEP] they don't know that it is the word,,, the word, the word \"not....\" [SEP] the jets took their chance to get back to the playoffs in time. [SEP] the jets took the lead in detroit on an afternoon, and the jets took the rest of the third [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] - - months, 7,, 13 days. [SEP] 14, 2007. [SEP] the earth has a lot of hope. [SEP] he really wants it. [SEP] - - in rpm ' s 14 - 5, which is located. 2 days of the week in order - - 18, 37 - - 14, 54. - -., 38 16, 37 16, 39 13, 16 - 14, and chicago - - 24 - day - - 14. - - - 13, 13, 14, 13 - 15, 11, 14, 11, and a,, 13, 15, 16,,, 16, 18, [SEP]", "detok_text": "[CLS] - - months, 7,, 13 days. [SEP] 14, 2007. [SEP] the earth has a lot of hope. [SEP] he really wants it. [SEP] - - in rpm's 14 - 5, which is located. 2 days of the week in order - - 18, 37 - - 14, 54. - -., 38 16, 37 16, 39 13, 16 - 14, and chicago - - 24 - day - - 14. - - - 13, 13, 14, 13 - 15, 11, 14, 11, and a,, 13, 15, 16,,, 16, 18, [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS] a small moment. [SEP] the 20 - year - man, who has not been named for the incident, was last seen. [SEP] have the courage to try again with the courage and the, and with the time to eat and work... [SEP] it is, to, say, a, a necessity. [SEP] he ' s just trying to get out of the way of a crisis - - and he tries to find a solution to make it better and better. [SEP] you have to put the knife to small pieces to arrange on the top, put a date in the middle and bring the rest of the flour to pieces. [SEP] [SEP]", "detok_text": "[CLS] a small moment. [SEP] the 20 - year - man, who has not been named for the incident, was last seen. [SEP] have the courage to try again with the courage and the, and with the time to eat and work... [SEP] it is, to, say, a, a necessity. [SEP] he's just trying to get out of the way of a crisis - - and he tries to find a solution to make it better and better. [SEP] you have to put the knife to small pieces to arrange on the top, put a date in the middle and bring the rest of the flour to pieces. [SEP] [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] - 16. 55 - -, ( 17 ), 21 - 60 - ( 12 ) - 60, 16 - 31 - - - - 16 - 17. 16, 18. 16, 37 - - 16 - 31 - 1 - 3, 000. 13 - 23, 73 - - place. 16 - 31 - 36, - - - -., -,, 49, 38 - 37, 49 - 16, 49 - 37 - 37 - 112. [SEP] do you really want to - - 20 - - 19 - 37 - b, bhutto 17 - - -, - - -,. - - - [SEP]", "detok_text": "[CLS] - 16. 55 - -, (17), 21 - 60 - (12) - 60, 16 - 31 - - - - 16 - 17. 16, 18. 16, 37 - - 16 - 31 - 1 - 3, 000. 13 - 23, 73 - - place. 16 - 31 - 36, - - - -., -,, 49, 38 - 37, 49 - 16, 49 - 37 - 37 - 112. [SEP] do you really want to - - 20 - - 19 - 37 - b, bhutto 17 - - -, - - -,. - - - [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] have children, think it ' s time for her to tell her story, and get to be the best friend in her family. [SEP] i was hit by a string of changes in chicago,, chicago, chicago, chicago,,,,,,,,,,,,,,,,,,,,,,,,,, and,. [SEP] the pistons have to move back, and down the road for detroit, boston, and detroit. [SEP] he returned to the lineup, leaving with back injuries. [SEP] when all the ballots have been turned, in michigan, chicago, florida, chicago, chicago, and [SEP]", "detok_text": "[CLS] have children, think it's time for her to tell her story, and get to be the best friend in her family. [SEP] i was hit by a string of changes in chicago,, chicago, chicago, chicago,,,,,,,,,,,,,,,,,,,,,,,,,, and,. [SEP] the pistons have to move back, and down the road for detroit, boston, and detroit. [SEP] he returned to the lineup, leaving with back injuries. [SEP] when all the ballots have been turned, in michigan, chicago, florida, chicago, chicago, and [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] have to struggle to balance the race with a place in the title. [SEP] in the beginning and top of it, he has asked, \" no have ever come to the top of the reality and take all the wheels, back, back and back, \" he said. [SEP] in the event,,,,, weeks, weeks,,,,, and turns out, day, day, a day, week,,,,,,,,,,,,,,,,,, and on the other side. [SEP] there was a bit of something to sit in the street, not the front rooms. [SEP] [SEP]", "detok_text": "[CLS] have to struggle to balance the race with a place in the title. [SEP] in the beginning and top of it, he has asked, \"no have ever come to the top of the reality and take all the wheels, back, back and back,\" he said. [SEP] in the event,,,,, weeks, weeks,,,,, and turns out, day, day, a day, week,,,,,,,,,,,,,,,,,, and on the other side. [SEP] there was a bit of something to sit in the street, not the front rooms. [SEP] [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS]..... in line for the week of december, 50, 000. [SEP] and as you point out, the first line is more than 1, 000 words. [SEP] the 24 - hour, back - to - back runs in the markets - - boston, chicago, boston - to, boston, mid - ohio, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, detroit,, chicago, chicago,,,, chicago, st., chicago, chicago and miami - to,,,,,,,,,....... a.,,.. [SEP]", "detok_text": "[CLS]..... in line for the week of december, 50, 000. [SEP] and as you point out, the first line is more than 1, 000 words. [SEP] the 24 - hour, back - to - back runs in the markets - - boston, chicago, boston - to, boston, mid - ohio, chicago, chicago, chicago, chicago, chicago, chicago, chicago, chicago, detroit,, chicago, chicago,,,, chicago, st., chicago, chicago and miami - to,,,,,,,,,....... a.,,.. [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] kind of business, - - 2007. [SEP] detroit 16, chicago, boston 88, 50 - 73, 50 - 95, the detroit, chicago, chicago, detroit. [SEP] in chicago, chicago - - - -, to have been traveling for at least 36 hours, on a 1, 000 - mile, chicago,, chicago, chicago - area and then on a private plane to cover the same - - 12 - 24 hours a day, 14 - 14,, a train to chicago, one - 12, 11, 14 - 14, and, to complete the one - hour, 12 - 14 -,, 12 - [SEP]", "detok_text": "[CLS] kind of business, - - 2007. [SEP] detroit 16, chicago, boston 88, 50 - 73, 50 - 95, the detroit, chicago, chicago, detroit. [SEP] in chicago, chicago - - - -, to have been traveling for at least 36 hours, on a 1, 000 - mile, chicago,, chicago, chicago - area and then on a private plane to cover the same - - 12 - 24 hours a day, 14 - 14,, a train to chicago, one - 12, 11, 14 - 14, and, to complete the one - hour, 12 - 14 -,, 12 - [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS],, 50, 50,,,,,,,,,.. [SEP],,, 51, 89,,, 51, 52, 48,,,,,,,,,. one of these days, 50, 50, 50, 50, 60,, 89, 60,,,, 89,,,,,,, 89, 60, 60, 51, 50, and,...,,, 50,,, 52,,,,,,,,,,,,, etc., indiana, indiana, michigan, ohio, indiana, illinois,,,, [SEP]", "detok_text": "[CLS],, 50, 50,,,,,,,,,.. [SEP],,, 51, 89,,, 51, 52, 48,,,,,,,,,. one of these days, 50, 50, 50, 50, 60,, 89, 60,,,, 89,,,,,,, 89, 60, 60, 51, 50, and,...,,, 50,,, 52,,,,,,,,,,,,, etc., indiana, indiana, michigan, ohio, indiana, illinois,,,, [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] - 13, -, - 8 - 0 - 0... - 11 - losses. [SEP] in addition, the first half of the user ' s consonants are meant to be \" a., \" 8,,, 12 - 60, \" b, \" 60, \" \" 10 - 80, \" 12 - 70, beginning of the 80 ' s, i, a, s, and in some way they are, \", to \",,, \",, \",, \" or, \" \" to other name. [SEP] it is now hard to explain how the situation was so similar to their sex. [SEP] [SEP]", "detok_text": "[CLS] - 13, -, - 8 - 0 - 0... - 11 - losses. [SEP] in addition, the first half of the user's consonants are meant to be \"a.,\" 8,,, 12 - 60, \"b,\" 60, \" \"10 - 80,\" 12 - 70, beginning of the 80's, i, a, s, and in some way they are, \", to \",,, \",, \",, \"or,\" \" to other name. [SEP] it is now hard to explain how the situation was so similar to their sex. [SEP] [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS] ), 49 - points. [SEP] 3 - 14 - - boston, a. -, - 16 - 00, and a. j. b., 12 -, - 14 - 00 to mid - morning trade. [SEP] a 2 percent decline from the 0. 5 - point - to - point - in - the - year average return of 1. 5 per cent. [SEP] the bulls, 73, 73,, 87, chicago, 24 - of, 41, 73, 50, 73, and 68, to the hawks in., boston, chicago, chicago. [SEP] the men, who, and two, of the [SEP]", "detok_text": "[CLS] ), 49 - points. [SEP] 3 - 14 - - boston, a. -, - 16 - 00, and a. j. b., 12 -, - 14 - 00 to mid - morning trade. [SEP] a 2 percent decline from the 0. 5 - point - to - point - in - the - year average return of 1. 5 per cent. [SEP] the bulls, 73, 73,, 87, chicago, 24 - of, 41, 73, 50, 73, and 68, to the hawks in., boston, chicago, chicago. [SEP] the men, who, and two, of the [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS], - 73, - 16, 13,, -, - 14, at - 16, at - 16, 73, ticker,,, 52, one of the franchise ' s best. [SEP] the helicopters, including two british pilots, have made hundreds of short - flight visits. [SEP] 13, detroit, 8 - 14. [SEP] but the savings of health - care are not applicable to many americans. [SEP] mr. zaff, 54, arrived at the end of the afternoon throngs of nearly 1, 000 people. [SEP] what a clever joke. [SEP] well, look for a couple of days, if said, [SEP]", "detok_text": "[CLS], - 73, - 16, 13,, -, - 14, at - 16, at - 16, 73, ticker,,, 52, one of the franchise's best. [SEP] the helicopters, including two british pilots, have made hundreds of short - flight visits. [SEP] 13, detroit, 8 - 14. [SEP] but the savings of health - care are not applicable to many americans. [SEP] mr. zaff, 54, arrived at the end of the afternoon throngs of nearly 1, 000 people. [SEP] what a clever joke. [SEP] well, look for a couple of days, if said, [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS], 37, 37, 37, 37, 49,,,,,,,,,, 49,,,, 49, the term \" 48,,, 48, 48, 52,,,,,,,, and etc. [SEP] the first national recession ended in the us in december. [SEP] bridge2. [SEP] 18,,, 21, etc., 16, 23, 21, 37, 31, 50 % in 24 - 37 minutes ( 18 - 40s, and 21 - 50s, etc. in less than three minutes ), 30 -,,,,,, 37, 48, [SEP]", "detok_text": "[CLS], 37, 37, 37, 37, 49,,,,,,,,,, 49,,,, 49, the term \" 48,,, 48, 48, 52,,,,,,,, and etc. [SEP] the first national recession ended in the us in december. [SEP] bridge2. [SEP] 18,,, 21, etc., 16, 23, 21, 37, 31, 50 % in 24 - 37 minutes (18 - 40s, and 21 - 50s, etc. in less than three minutes), 30 -,,,,,, 37, 48, [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] to shut by the end of 2008. [SEP] ted kennedy, a mother, died of cancer. [SEP] and then, back to your place. [SEP] in the end the game at right flanker brandon moss was the way it was. [SEP] the lead is at 10 - 20. [SEP] the magic number is around 100, and the answer is to reckoning it ' s only 20. [SEP] for a long time, not days. [SEP] i ' m really trying to return to detroit, too.... [SEP] a little - thaned majority has in a couple of shaky runs in boston, and the first in the best - - [SEP]", "detok_text": "[CLS] to shut by the end of 2008. [SEP] ted kennedy, a mother, died of cancer. [SEP] and then, back to your place. [SEP] in the end the game at right flanker brandon moss was the way it was. [SEP] the lead is at 10 - 20. [SEP] the magic number is around 100, and the answer is to reckoning it's only 20. [SEP] for a long time, not days. [SEP] i'm really trying to return to detroit, too.... [SEP] a little - thaned majority has in a couple of shaky runs in boston, and the first in the best - - [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS], days, boston time, d, chemph, canada time and again, detroit, boston, chicago, same place, boston again, chicago, chicago, all days, again, to the spring, again, again, and next time to put him back and see if he just try to move, from time to time... president karzai is the time for him..., again, for the place to move, and he the time to date, time to time... [SEP] time to move to the top, get back to the top, time to finish. [SEP] and itʼs [SEP]", "detok_text": "[CLS], days, boston time, d, chemph, canada time and again, detroit, boston, chicago, same place, boston again, chicago, chicago, all days, again, to the spring, again, again, and next time to put him back and see if he just try to move, from time to time... president karzai is the time for him..., again, for the place to move, and he the time to date, time to time... [SEP] time to move to the top, get back to the top, time to finish. [SEP] and itʼs [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] we are the first country of the world to pay 7, 000.... well, this is the most of the year in all, \" the president said. [SEP] later in the week, \" the statement said. [SEP] he take the road on the road.... take the road, take the road to take the end of the road,, the road, to to the road in the middle, rather than take the road to the road, to get to nowhere, and thus, have to have to move, in order to move on a sort of path. [SEP] in addition, the united administration has been [SEP]", "detok_text": "[CLS] we are the first country of the world to pay 7, 000.... well, this is the most of the year in all, \"the president said. [SEP] later in the week,\" the statement said. [SEP] he take the road on the road.... take the road, take the road to take the end of the road,, the road, to to the road in the middle, rather than take the road to the road, to get to nowhere, and thus, have to have to move, in order to move on a sort of path. [SEP] in addition, the united administration has been [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS], 18 - 21, 16 - 14... 14 - 21, 17 - 18, 37, 51, 37 - 37, and 7. 30, 14 - 16, 24, 24.., -, 13 - 14, 14 - 15, 23 - 14, and 14, 14, 16 - 14, 14 by the sc. [SEP] 13 - 14,, 37, 16 -,,, 73, 60, 49, 48 - 49, 45 - 37, and 49, 37, and,, 37, 37,, date of the,, 31, 37,,,,,,, the [SEP]", "detok_text": "[CLS], 18 - 21, 16 - 14... 14 - 21, 17 - 18, 37, 51, 37 - 37, and 7. 30, 14 - 16, 24, 24.., -, 13 - 14, 14 - 15, 23 - 14, and 14, 14, 16 - 14, 14 by the sc. [SEP] 13 - 14,, 37, 16 -,,, 73, 60, 49, 48 - 49, 45 - 37, and 49, 37, and,, 37, 37,, date of the,, 31, 37,,,,,,, the [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] - or less, or,, day, back, a, two days in the kitchen. [SEP] assistss, detroit 90, chicago, detroit 89, chicago, chicago 89, chicago, chicago 89, chicago, chicago. [SEP] in the last few days, we have a 65, 000 - to - 1, 300 - capacity schedule. [SEP] given the current economic climate, i know it would also be a lot. [SEP] are you over worried? [SEP] but the talks aren ' t about to change the relationship and provide some change. [SEP] \" i can see that it doesn ' t work for us. [SEP] a statement to the [SEP]", "detok_text": "[CLS] - or less, or,, day, back, a, two days in the kitchen. [SEP] assistss, detroit 90, chicago, detroit 89, chicago, chicago 89, chicago, chicago 89, chicago, chicago. [SEP] in the last few days, we have a 65, 000 - to - 1, 300 - capacity schedule. [SEP] given the current economic climate, i know it would also be a lot. [SEP] are you over worried? [SEP] but the talks aren't about to change the relationship and provide some change. [SEP] \" i can see that it doesn't work for us. [SEP] a statement to the [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] said. [SEP] the week was the week,, and hour of rest, period of work. [SEP] that means,, time and time - - and time was extended,,,.,, and, ' s......, 13, 26,... and the number,,,,,, 38, etc. [SEP] in course, if you a woman is have the opportunity and the opportunity to make the show, she ' ll be able to do that in a couple of of days. [SEP] that ' s not to say the term \" crisis \" will give up to the turmoil in the region [SEP]", "detok_text": "[CLS] said. [SEP] the week was the week,, and hour of rest, period of work. [SEP] that means,, time and time - - and time was extended,,,.,, and,'s......, 13, 26,... and the number,,,,,, 38, etc. [SEP] in course, if you a woman is have the opportunity and the opportunity to make the show, she'll be able to do that in a couple of of days. [SEP] that's not to say the term \"crisis\" will give up to the turmoil in the region [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] -, say, 14 -, - 08, and that is, waiting for their own assets to be wiped out. [SEP] 50, 98 - 70, 98 - 70, 73 -, 50, 73 -, 30, 37, and 38, to 49, to 1, 31, -,, 37, -,, 18 - 15, 31 - 48, 52 - 30,, 52 - 45 days. [SEP] the plan plans to pay a minimum end - to - end - - in kind of, december to end 2009, at, $ 41, 000, and then, in order to prevent any of the capital [SEP]", "detok_text": "[CLS] -, say, 14 -, - 08, and that is, waiting for their own assets to be wiped out. [SEP] 50, 98 - 70, 98 - 70, 73 -, 50, 73 -, 30, 37, and 38, to 49, to 1, 31, -,, 37, -,, 18 - 15, 31 - 48, 52 - 30,, 52 - 45 days. [SEP] the plan plans to pay a minimum end - to - end - - in kind of, december to end 2009, at, $41, 000, and then, in order to prevent any of the capital [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS], he said. [SEP] i have been 50 and working three times in the past two years. [SEP] the idea is to bring the passengers and bring the next train to chicago, at one point.. [SEP] however, mr sahn does not understand, that even one of the other people in power has such attention. [SEP] what we is a mix - - mix, vanilla - ice vanilla, sour milk, dark bread, vanilla, warm milk puree, buttery bread, deep vanilla, fresh vanilla, red and vanilla, fresh sour, fresh milk cheese, vanilla, fresh breads, vanilla, sour bread, fresh milk, [SEP]", "detok_text": "[CLS], he said. [SEP] i have been 50 and working three times in the past two years. [SEP] the idea is to bring the passengers and bring the next train to chicago, at one point.. [SEP] however, mr sahn does not understand, that even one of the other people in power has such attention. [SEP] what we is a mix - - mix, vanilla - ice vanilla, sour milk, dark bread, vanilla, warm milk puree, buttery bread, deep vanilla, fresh vanilla, red and vanilla, fresh sour, fresh milk cheese, vanilla, fresh breads, vanilla, sour bread, fresh milk, [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS], 1996, boston, 1996,,, 2004, \" a period that has lasted for a year in the first half of the season, not a full year. [SEP] 13, chicago, 11, 10, chicago, -,, 7, 732, 400, 6, 900, 000 - - all built from the top of the pile. [SEP] he then dressed in a black tie, took a chicago - style flight, and then a flight to chicago, chicago, chicago to chicago, chicago, boston, chicago, chicago, chicago to boston,, chicago bulls, chicago, chicago, chicago etc. [SEP] the company, [SEP]", "detok_text": "[CLS], 1996, boston, 1996,,, 2004, \" a period that has lasted for a year in the first half of the season, not a full year. [SEP] 13, chicago, 11, 10, chicago, -,, 7, 732, 400, 6, 900, 000 - - all built from the top of the pile. [SEP] he then dressed in a black tie, took a chicago - style flight, and then a flight to chicago, chicago, chicago to chicago, chicago, boston, chicago, chicago, chicago to boston,, chicago bulls, chicago, chicago, chicago etc. [SEP] the company, [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] cars, and children, on the road. [SEP] in fact, mr brown ' s school has never back on its own. [SEP] place the tomato place in the middle place, the place on the ground, the top - in place, two in the top, the top, place, place and one in the bottom, in place with the flour back on the ground. [SEP] the talk is based on the basis that his point was, line, line, line in,, line in the line,,,,, for one.,, and it ' s line - a - back,,, and,,,, [SEP]", "detok_text": "[CLS] cars, and children, on the road. [SEP] in fact, mr brown's school has never back on its own. [SEP] place the tomato place in the middle place, the place on the ground, the top - in place, two in the top, the top, place, place and one in the bottom, in place with the flour back on the ground. [SEP] the talk is based on the basis that his point was, line, line, line in,, line in the line,,,,, for one.,, and it's line - a - back,,, and,,,, [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS] a day of days, but a day the week, not, the week,........ [SEP] at a cost of a thousand or 50 dollars, it is going to be \" everything that ends with a lot of money, \" mancini told the news. [SEP] companies and we need to have a good relationship to customers. businesses, technology and the manufacturers of large power products and high - service products. solutions. [SEP] when he asked to look at the tv guideline, the reporter he was able to find access to thousands of information and learn what other news media would to do : get access to the [SEP]", "detok_text": "[CLS] a day of days, but a day the week, not, the week,........ [SEP] at a cost of a thousand or 50 dollars, it is going to be \"everything that ends with a lot of money,\" mancini told the news. [SEP] companies and we need to have a good relationship to customers. businesses, technology and the manufacturers of large power products and high - service products. solutions. [SEP] when he asked to look at the tv guideline, the reporter he was able to find access to thousands of information and learn what other news media would to do: get access to the [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] costs that will make up for tens of millions of jobs. [SEP] it ' s not the end of the olympics, here, anyway, in chicago. [SEP] not to have it, anyway. [SEP] the series ended in a tie before the series began in chicago. [SEP] in a minute, prepare, and you, to turn,,,, flip - -, grind, stack, slice, and - - - for the past 2 hours. [SEP] i ' ll never make a case. [SEP] but with a clear, breakfast, a beer, a soup, two bread, all that stuff,.. [SEP] no regrets. [SEP] he [SEP]", "detok_text": "[CLS] costs that will make up for tens of millions of jobs. [SEP] it's not the end of the olympics, here, anyway, in chicago. [SEP] not to have it, anyway. [SEP] the series ended in a tie before the series began in chicago. [SEP] in a minute, prepare, and you, to turn,,,, flip - -, grind, stack, slice, and - - - for the past 2 hours. [SEP] i'll never make a case. [SEP] but with a clear, breakfast, a beer, a soup, two bread, all that stuff,.. [SEP] no regrets. [SEP] he [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] - - - 5. - -, 37, 48, - - - 13. [SEP] \" the time the moment changes everything, there ' s a bit of continuity, a kind of a break, i think - - - - - - - - - - - - - - - - - - - - - - - - - -, \" he said. [SEP] in the past couple of seasons, the field of - - - 14, 16,, 16, 16, 24, 16, 24,, 20, 30,, 30, 50, and acs. - - was the first two games of the series [SEP]", "detok_text": "[CLS] - - - 5. - -, 37, 48, - - - 13. [SEP] \"the time the moment changes everything, there's a bit of continuity, a kind of a break, i think - - - - - - - - - - - - - - - - - - - - - - - - - -,\" he said. [SEP] in the past couple of seasons, the field of - - - 14, 16,, 16, 16, 24, 16, 24,, 20, 30,, 30, 50, and acs. - - was the first two games of the series [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 24. 7. - 24 - 24, 14 days 24 - 24 - 7 days - - 24, 48 - 24 days, february 24, february 24, 24 - 16, 24 - 23. 4 days in pre - 24, days 33, even in the middle of the day, 24 - 24 - 26. days time to day - ( telecoms, 481. 13 - 26, 24, 48 -,. - ba. co. uk ). 7 days has 3. 4 hours, 73 days but has a few days, and is on the right to week 24 - 24. days on a 13 - [SEP]", "detok_text": "[CLS] 24. 7. - 24 - 24, 14 days 24 - 24 - 7 days - - 24, 48 - 24 days, february 24, february 24, 24 - 16, 24 - 23. 4 days in pre - 24, days 33, even in the middle of the day, 24 - 24 - 26. days time to day - (telecoms, 481. 13 - 26, 24, 48 -,. - ba. co. uk). 7 days has 3. 4 hours, 73 days but has a few days, and is on the right to week 24 - 24. days on a 13 - [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] have been doing so in the middle of december. [SEP] 13 of 1996 - 73. [SEP] mr. jordan, who is just weeks, is to end his writing assignment. [SEP] the tomato is a bit in the process of baking, and add a little to make a good pasta feel. [SEP] the period would still run to days, days, days, days and even days. [SEP] the camera is in the chaos, and in the end of the chaos, the lights are white. [SEP] but a lack of activity in the second quarter could mean profits in the run up to the current level of 50p, he said. [SEP] \" [SEP]", "detok_text": "[CLS] have been doing so in the middle of december. [SEP] 13 of 1996 - 73. [SEP] mr. jordan, who is just weeks, is to end his writing assignment. [SEP] the tomato is a bit in the process of baking, and add a little to make a good pasta feel. [SEP] the period would still run to days, days, days, days and even days. [SEP] the camera is in the chaos, and in the end of the chaos, the lights are white. [SEP] but a lack of activity in the second quarter could mean profits in the run up to the current level of 50p, he said. [SEP] \" [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] time to turn, period to end, period, period,,, and back - time. [SEP] 12 - 14, 14 - 14. [SEP] year 7, 26,, 38,, 37,, 16, 15, 17, 15, 36,,,, 48.,, 48, 48, and 48,,,,,, and, time to date in the same period. [SEP] a great sense of it is that the end of the economic century was over. [SEP] look at that, 16. 5 % ( and. 4 % ). [SEP] the third man, between the 50 and 90, is the [SEP]", "detok_text": "[CLS] time to turn, period to end, period, period,,, and back - time. [SEP] 12 - 14, 14 - 14. [SEP] year 7, 26,, 38,, 37,, 16, 15, 17, 15, 36,,,, 48.,, 48, 48, and 48,,,,,, and, time to date in the same period. [SEP] a great sense of it is that the end of the economic century was over. [SEP] look at that, 16. 5 % (and. 4 %). [SEP] the third man, between the 50 and 90, is the [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] stands at the moment, 1, 0007. [SEP] and on days 14, 24,,,,, 18, 23, 36,,, 48, 37, 36,,,, 90 days, 36,,,, and, 36,,, 48,, 48, double - skied. [SEP] 14 when he was 46, and in he. [SEP] the nos. 5 - 13 season, game against ohio state. [SEP] to do, the worst thing of all is, to do, they will have to change the mind and in effect... and then he might throw on the door. [SEP] the [SEP]", "detok_text": "[CLS] stands at the moment, 1, 0007. [SEP] and on days 14, 24,,,,, 18, 23, 36,,, 48, 37, 36,,,, 90 days, 36,,,, and, 36,,, 48,, 48, double - skied. [SEP] 14 when he was 46, and in he. [SEP] the nos. 5 - 13 season, game against ohio state. [SEP] to do, the worst thing of all is, to do, they will have to change the mind and in effect... and then he might throw on the door. [SEP] the [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS] - - the road to finish, again, back to line, period, and back to again, back to 52. - - - - - back to back - - - - - - and back, again. -, err, back to finish - - and, eventually, time to stand in place, and, to, time to end up to, back, end, ( in, end ). [SEP] for example, the new approach, is seem to be a simple, back - to - end, designed to make the turn, end, end, and back - stop. [SEP] the penguins, 14 - 14 [SEP]", "detok_text": "[CLS] - - the road to finish, again, back to line, period, and back to again, back to 52. - - - - - back to back - - - - - - and back, again. -, err, back to finish - - and, eventually, time to stand in place, and, to, time to end up to, back, end, (in, end). [SEP] for example, the new approach, is seem to be a simple, back - to - end, designed to make the turn, end, end, and back - stop. [SEP] the penguins, 14 - 14 [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS]. [SEP] chicago, washington - - 18 - 1 - 5 - 0 - - 0 - 3.... [SEP] it ' s time to know the meaning of the in the truth. [SEP] that ' s the end of the day, all of the actors come to the top. [SEP] by eliminating the effect in the midst of an upset with the playoffs, the patriots dropped out of the playoffs and losing with the playoffs, a and - 0 at the end of the best season of the 2004 conference championship. [SEP] provider - 3 is the only ethernet solution, and allows the use of multi - mode solutions. [SEP] however, [SEP]", "detok_text": "[CLS]. [SEP] chicago, washington - - 18 - 1 - 5 - 0 - - 0 - 3.... [SEP] it's time to know the meaning of the in the truth. [SEP] that's the end of the day, all of the actors come to the top. [SEP] by eliminating the effect in the midst of an upset with the playoffs, the patriots dropped out of the playoffs and losing with the playoffs, a and - 0 at the end of the best season of the 2004 conference championship. [SEP] provider - 3 is the only ethernet solution, and allows the use of multi - mode solutions. [SEP] however, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] that it is going to be the end of the road. [SEP] a. i have a house,,,,,, in a small plane,,, on the airplane, in,, in anything that it is. [SEP],, stand on the spot, and then...,,,,,,,,,,,,,,,,,,,,,, the type of,,,,,,,,,,,,,,,,,,,, etc.,,, 50, 49,, 54, 00mph.,,,,,, 48 [SEP]", "detok_text": "[CLS] that it is going to be the end of the road. [SEP] a. i have a house,,,,,, in a small plane,,, on the airplane, in,, in anything that it is. [SEP],, stand on the spot, and then...,,,,,,,,,,,,,,,,,,,,,, the type of,,,,,,,,,,,,,,,,,,,, etc.,,, 50, 49,, 54, 00mph.,,,,,, 48 [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] [SEP] the company lost three operations in the end of 2008. [SEP] you need to get back to a simple date.... [SEP] if only, days, days, days, days,,,, days, days,,, period, to put them in 10, 10, 11. [SEP] if you have to speak something for you yet, you will have to call out the year,,, period, the year,,,,,,, period, and until the rest is same, period, period, to the end, the place of time, the time, place, the place, place, the top [SEP]", "detok_text": "[CLS] [SEP] the company lost three operations in the end of 2008. [SEP] you need to get back to a simple date.... [SEP] if only, days, days, days, days,,,, days, days,,, period, to put them in 10, 10, 11. [SEP] if you have to speak something for you yet, you will have to call out the year,,, period, the year,,,,,,, period, and until the rest is same, period, period, to the end, the place of time, the time, place, the place, place, the top [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] uk, the company has has partnerships with other regional organisations, such as the royal and the british transport union. [SEP] he did not know if any other,,,,,,,,,, part of the original, was a series of elaborate tribbles. [SEP] i don ' t see the room for that to happen. [SEP] he is what i know is not going for a while, but he would be forced to take a conversation with his family, at least. [SEP] he doesn ' t know what the answer to be, is you to love your friends, but you need to talk together. [SEP] according to the [SEP]", "detok_text": "[CLS] uk, the company has has partnerships with other regional organisations, such as the royal and the british transport union. [SEP] he did not know if any other,,,,,,,,,, part of the original, was a series of elaborate tribbles. [SEP] i don't see the room for that to happen. [SEP] he is what i know is not going for a while, but he would be forced to take a conversation with his family, at least. [SEP] he doesn't know what the answer to be, is you to love your friends, but you need to talk together. [SEP] according to the [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] to increase the length and auto - end of the line to reach capacity for the post - trip 2008 miles. [SEP] the line, which hit the 16 - to - road - in line, formed from the main - - - - - - - line. - - - - - - - in - - - - - b / c the road - to - line -, line - to - line. road - to - place in the line - to - line, base line, top - line in the base line, top - line - in the line in the top, and in the 12 - and - 10 - line [SEP]", "detok_text": "[CLS] to increase the length and auto - end of the line to reach capacity for the post - trip 2008 miles. [SEP] the line, which hit the 16 - to - road - in line, formed from the main - - - - - - - line. - - - - - - - in - - - - - b/c the road - to - line -, line - to - line. road - to - place in the line - to - line, base line, top - line in the base line, top - line - in the line in the top, and in the 12 - and - 10 - line [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS], goes to the heavy - metal ballads of the last british musical \" days after the lights, \" for a paperback. [SEP] turn to the freshly - houdini breads, pick on the brilliantly sliced thick flavors of red bread and the crisply crisp potatoes. [SEP] what a place you are, go piece by piece, bring on the soften. [SEP] then,, then, then, now, then they get back together, to get up, sleep and... they are all just together... [SEP] a major part of the project. [SEP] 18, 2008 in the white house in washington, d. [SEP]", "detok_text": "[CLS], goes to the heavy - metal ballads of the last british musical \"days after the lights,\" for a paperback. [SEP] turn to the freshly - houdini breads, pick on the brilliantly sliced thick flavors of red bread and the crisply crisp potatoes. [SEP] what a place you are, go piece by piece, bring on the soften. [SEP] then,, then, then, now, then they get back together, to get up, sleep and... they are all just together... [SEP] a major part of the project. [SEP] 18, 2008 in the white house in washington, d. [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS]... [SEP] \" a lot of time is \" due to the shortcoats. [SEP] the yarns are not thick enough in layers of linen - - -, - - -, - and, a - - - - and in short threads. [SEP] that is the case, a..., - double - area, double -, double -,,, -, -,,, in -, -,, -,,, -, -, -,, u. s. 78, b -,, b -,, -,,, -, -, and -, -.. [SEP]", "detok_text": "[CLS]... [SEP] \"a lot of time is\" due to the shortcoats. [SEP] the yarns are not thick enough in layers of linen - - -, - - -, - and, a - - - - and in short threads. [SEP] that is the case, a..., - double - area, double -, double -,,, -, -,,, in -, -,, -,,, -, -, -,, u. s. 78, b -,, b -,, -,,, -, -, and -, -.. [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] ' s going to get a bit of work together and finish the relationship, then the momentum goes to the back, \" he said. [SEP] instead, expect everyone in any given place - - with the service, but, on the train - - to have a spot in everyone ' s hand. [SEP] his appointment would be a significant blow in the face of the crisis as eu leaders struggled to elect the pro - european minister. [SEP] 22 - weeks ( 18 ), 13 days to work 12 - 14 ( h2 - 19o ), 24 - days..., 16 days twice a week, 14 - 12 weeks of [SEP]", "detok_text": "[CLS]'s going to get a bit of work together and finish the relationship, then the momentum goes to the back, \" he said. [SEP] instead, expect everyone in any given place - - with the service, but, on the train - - to have a spot in everyone's hand. [SEP] his appointment would be a significant blow in the face of the crisis as eu leaders struggled to elect the pro - european minister. [SEP] 22 - weeks (18), 13 days to work 12 - 14 (h2 - 19o), 24 - days..., 16 days twice a week, 14 - 12 weeks of [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/summary.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/summary.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..55626e6b614abc4a1ed3ad7684868d9b080e7b6e --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/summary.jsonl @@ -0,0 +1,2 @@ +{"type": "summary", "name": "state_c256_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c256_t1p45", "steps": 16, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 42.769466206615945, "nll_per_token": 3.7558244416048425, "tokens": 8694}, "diversity": {"sample_entropy": 3.1708587735321347, "unique_tokens": 1049, "token_count": 8192, "distinct_1": 0.1280517578125, "distinct_2": 0.41313976377952755, "top_token_mass": 0.22607421875}} +{"type": "summary", "name": "state_c1024_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c1024_t1p45", "steps": 16, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 24.348744185198743, "nll_per_token": 3.1924802746955083, "tokens": 7297}, "diversity": {"sample_entropy": 2.0679188483539344, "unique_tokens": 615, "token_count": 8192, "distinct_1": 0.0750732421875, "distinct_2": 0.23363681102362205, "top_token_mass": 0.392578125}} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/summary.tsv b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/summary.tsv new file mode 100644 index 0000000000000000000000000000000000000000..80c829e6052a4589dd435f0efdef55b121c98e71 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_16/summary.tsv @@ -0,0 +1,3 @@ +name step detok_genppl sample_entropy distinct_2 top_token_mass model_t_mode support_power semantic_power final_from endpoint_temp concentration_max update +state_c256_t1p45 124000 42.769466206615945 3.1708587735321347 0.41313976377952755 0.22607421875 post 1.0 1.0 state 1.45 256.0 resample +state_c1024_t1p45 124000 24.348744185198743 2.0679188483539344 0.23363681102362205 0.392578125 post 1.0 1.0 state 1.45 1024.0 resample diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/state_c1024_t1p45_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/state_c1024_t1p45_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..1bc6d76a7fd3ea6c222dd0df5d515af7b073c6b1 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/state_c1024_t1p45_detok_raw_samples.txt @@ -0,0 +1,228 @@ +state_c1024_t1p45_detok +{ + "type": "summary", + "name": "state_c1024_t1p45", + "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", + "step": 124000, + "decode": { + "kind": "categorical_fullvocab", + "config": "state_c1024_t1p45", + "steps": 32, + "model_t_mode": "post", + "support_power": 1.0, + "semantic_power": 1.0, + "endpoint_temp": 1.45, + "concentration_min": 1.0, + "concentration_max": 1024.0, + "final_from": "state", + "update": "resample", + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 31.13635173493272, + "nll_per_token": 3.438376002668099, + "tokens": 9165 + }, + "diversity": { + "sample_entropy": 3.3146319833825286, + "unique_tokens": 1102, + "token_count": 8192, + "distinct_1": 0.134521484375, + "distinct_2": 0.4309793307086614, + "top_token_mass": 0.2288818359375 + } +} + +===== sample 000 ===== +[CLS] at the end of a deal. [SEP] science has found that it is true and makes no sense........ to back - to - back, 50, 50 to - 50, 50, 37, 48, 45, 45, and 52. [SEP] "there was no time, on the same day, at the same time, no days, even days, just seven days, i do," he said. [SEP] he did not even let me dwell on the challenges of that... [SEP] we'll vote for obama.... [SEP] the meeting, called for monday afternoon, is to [SEP] + +===== sample 001 ===== +[CLS] 25, 40, 50, 50, 50, 60, 60, and the same period, when the hawks' worst record was 14 - 14. [SEP] asheville, n. d., studied at the university of ohio, ohio, illinois university, ohio, texas, illinois, canada, ireland, the university of carolina and canada. [SEP] "i think he has an option," romo said. [SEP] if the person is really prepared to do the job, this is a new beginning. [SEP] the group raised $16. 7 million in obama's first three days of campaign. [SEP] he ended a two - game [SEP] + +===== sample 002 ===== +[CLS] - - - flights of 2, 07,, 07, and in for at least five hours - -,,,,,, 45,,, 52. [SEP] at the end of the day, he said, the pilot still managed to retrieve the severed parts of the plane. [SEP] in other cases, the combination of warmth and warmth. [SEP] the political leader has raised his official concern about the war in the time of the election as being "ridiculous." [SEP] now, they would like to have a child with a doctor to get just a bit in the right room. [SEP] he then emerged from the balcony of the building [SEP] + +===== sample 003 ===== +[CLS] of the period, period prior to making a decision, a period, period, period,,,,, period, period, period,,,,, day, period, day, period,, period,,,,,,, period, period. [SEP] and so, the period,, period, period, period,,,,,, period,,,,,,,,, period,,, period, period, period,, period, period, period,,,,,,, and period, the day is days, days, period, period, period, period,,,, [SEP] + +===== sample 004 ===== +[CLS] century - old building. [SEP] "we have a lot of back - game games but, i remember, we have not had a game since 2003," he said. [SEP] instead, after 1914 and 1868, the convention to collapse in power led to the collapse of british communism. [SEP] "the peak - to -, peak - to - - to - trough period... the days of december 1988, beginning in 1988, to - back - to - back period, and 1988, and december 2007, and,,,,, 1996, 1997,,,,, and, 2003," he said. [SEP] he [SEP] + +===== sample 005 ===== +[CLS] december 16, 2008 in chicago. [SEP] kiwis is out for two months, days, weeks,, in the week to week, - -, week, week, week, week,, and week. [SEP] the bears are to face a series in chicago on - 16, dec. [SEP] he is going to be out of town for an interview. [SEP] boston, detroit 11 - 16, 11 - 11,, 11, and 11 - - to complete season - to - season winnings. [SEP] in his first year at the school, he died. [SEP] a group of protesters in the capital opened the door for its [SEP] + +===== sample 006 ===== +[CLS] 21. 50. [SEP] obama says, days, days, days, in the morning, in the morning, and time to date these days, week, day, week,,, period. [SEP] the three - break began over a 15 - day period, a week of the end of the day and the rest of the night's day in the afternoon. [SEP] from three days, in the first quarter, to the next, 4, 4, 6, 8, 8, 11, and and, to the end of 2008. [SEP] the atlantis v, a space plane, is scheduled to take off at 7: 15 [SEP] + +===== sample 007 ===== +[CLS] said. [SEP] "we could say, it's the time to talk of bankruptcy," said said robert woodley, the president of the national automobile trade association of america, which organizes the union. [SEP] in the u. s., flights begin to 3, 000, 000 feet at the start of the day and increase to more than 30 -, -, -, -, -, -, -, -, 1, 000 - -. [SEP] notes: @ 4 - 4, detroit 0, calgary 0 - 6 - 2 - 2... [SEP] on december 14, 25, 2006, of the 91 [SEP] + +===== sample 008 ===== +[CLS] 13 - year - old. [SEP] face - by - face, after all, at the end of her life, she was given time to time, time to time, time to time to time again. [SEP] now, the economy is in - - and in the future. [SEP] the two season series of games in cleveland, which is on june of - 14 in boston, the road series in atlanta and the game of the best - of - five series in san francisco. [SEP] finally, the bill of purchase was passed to the cpcb and the queen's for the period of which amounts to 100 days, respectively. [SEP] [SEP] + +===== sample 009 ===== +[CLS],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and, in the first half of the year. [SEP] 13,, 14, 15, 15, 15, 30, and 4, 52... [SEP] of course, the team is completely out of place,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, of the year,,,,,,,,,,,,,, and,. [SEP] he [SEP] + +===== sample 010 ===== +[CLS]9. 50 per person, including for a day - to - school stay. [SEP] it is expected to be 65,,,,,,,, 45, 51, 48,, 48, 48, 37, 48, 48. [SEP] the company's firm's list of operations in the trade is expected to include: 50,, 50, 60, 60, 50,, 50, 50,,,, 36,,,,,,,,,,,,,,,,,,, etc. [SEP] if the jets were to show in depth, the teams would be ready to move, [SEP] + +===== sample 011 ===== +[CLS] said he was given the opportunity to play in the olympics so far. [SEP] 51, 48 and it's day,,,,, day - - there'll be people to move,,,,,,,,,,,,,,, 48,, 48, 36,, 27,, 48,,,,,,,,,,, 48,,,, 48, the rest. [SEP] from the field,,,,,,, 49, 48, 49, 52, 54, seems to make the most of the woes,,,,,,,,,, [SEP] + +===== sample 012 ===== +[CLS] you can see that the author has a bit of scented cake, the scented fruit has an awful scented curse on the table. [SEP] in fact, the results will come soon, not even later. [SEP] the meeting was in fact a year away. [SEP] and then, more than 1, 200 passengers, including passengers, had to return to the airport monday morning to begin the 12 - hour stopover. [SEP] we have to talk come, come, break, we have to talk. [SEP] once they do, they will be able to feel, and when they do not feel back, they will feel more of a shock. [SEP] the [SEP] + +===== sample 013 ===== +[CLS] the rest of the 2004 - 7, including the back - to - back trip to the playoffs. [SEP] detroit 7, minnesota 27, 26, chicago,, cleveland,, chicago,, 50 - 48. - for the week, dec. - 60, 50 - 73, 50 - 73, 50 - 50, and beyond. - - 50 - 50, 37, 50, 50, 50, 50, parts of 50 - 49, 50 - 45, 60 - 50, in new york, boston 37, 50, boston 48, 50 - 50, 52, 60 - 60 and 48. - -,,, [SEP] + +===== sample 014 ===== +[CLS] we have to do it all together. [SEP] the man,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, to grow - up to his, and, oh, he opened his eyes at the end of the journey, and "no one wants to be sure what he wants to be," he said. [SEP] however, the current period was about a year earlier and is much longer. [SEP] the guy who will, he said, make the tens of thousands of dollars. [SEP] " i think they have to do it again. [SEP] [SEP] + +===== sample 015 ===== +[CLS] good friend, not a woman,, sits in the back of the house, but has not been wearing an eye. [SEP] chicago, september 11, 2008, and chicago, dec. [SEP] of course, 50,, 50, 60, by the end of........ 60, 50, 50, and in the end, they want to be. [SEP] with more than a week left after tuesday's quake, trucks and dump piled with hundreds of cars and collapsed on the roofs of government buildings. [SEP] "i was the first person to give me something to play during the day," he said [SEP] + +===== sample 016 ===== +[CLS]. [SEP] with the examples above, it would be time to have a good day in 2009. [SEP] the flight crew, miraculously, took the way to the airport and then returned to the prison area for their rescue. [SEP] a few years after being introduced to saba, he is on the field, and he will be a highlight of the day. [SEP] the european transport committee has already provided such help. [SEP] rondo, who has 22, 13 assists and eight assists this season, scored seven straight points. [SEP] 11, not again, but for the first time in 13 days. [SEP] today, december 21, 2007, [SEP] + +===== sample 017 ===== +[CLS], the met's co - artistic director. [SEP] her goal was to have that the rest of her life, writing letters to read, arranging, and, sometimes, to write poems. [SEP] the period: 2 - 2 _ detroit 18, chicago 7, detroit - - bay, chicago, detroit 20 (4. 36 pp). [SEP] according to the survey, back to 2003, it came to nothing. [SEP] for some reason, the colts lost the series to detroit, too. [SEP] "i feel sorry, and he seems to have to look for that," she said. [SEP] a few years later, however, [SEP] + +===== sample 018 ===== +[CLS] cent in december, the current reduction of 3. 8 to - 4. 9 per cent. [SEP] days of the past few days, days, days, days days to get in. days by the same week, days, week, week. [SEP] chicago - he's 50, 73, 73, 73, 73, 73, 73... [SEP] of course, after 50, 60, 65, they just are working days, days, weeks, and.. [SEP] vanilla, textured vanilla, chocolate - vanilla, sweet vanilla, sugared, vanilla, and salted, anded, at the start of the [SEP] + +===== sample 019 ===== +[CLS] - 15, 18, 15, 16, 16, 16,, 16, 18, and then,. 13, 1 - 18, 1 - 3, 14 - 15, 26, 26, 16, 18,,,, 16,,, 16, 16,, 13 - 16, 16 - 17, at about 0630 bst on december 7. [SEP] the magic led, 51 - 48, charlotte, chicago, (25 - 14, 16 - 16, 16 - 14). [SEP] i have to say you have a chance to breathe, tim. [SEP] the man, a wavy, hefty black [SEP] + +===== sample 020 ===== +[CLS] period - to - period for the day, period, period, period, period, time to start, period, - - to the end, period, period, day, day,, in the period,, with debrinks and day, period. [SEP] he said the planes were period, 50 -,,,,,,,,,,, 30 - and 50 - to weeks. [SEP] mr brown said that the meeting was full, normally, and that he had been assigned to the site to participate in training hours. [SEP] "we've cut back from week to week to week to," he [SEP] + +===== sample 021 ===== +[CLS] the first quarter, 1991 and 1996. [SEP] in the pre - trade agreement, the teams chicago, chicago, chicago, chicago, chicago, new york, chicago, chicago and detroit, which has chicago in chicago, called the city council, which specializes in the cities of chicago, chicago, chicago and chicago, a "chicago alliance." [SEP] the children are not expected to appear for about 15 minutes. [SEP] "for now, we've been told, the stock is not going to come down," mchaeag said. [SEP] we'll wait a little while to see the end come time after time again. [SEP] [SEP] + +===== sample 022 ===== +[CLS], gordon (54), blaney (detroit, 54). [SEP] in a typical time period, at half - time, the period period, period, 50,, 40,, 50,, 50, 60, 50, and 52. [SEP] we are not a dog,, to have a dog,,,, to have a dog. [SEP] meanwhile, if we have built a universe of opportunity - - 50 years or less - - then the vision of social mobility will become even more profound - - just when you know days, days,, days, days, days,,,,,,,, [SEP] + +===== sample 023 ===== +[CLS] into different areas of the city, which ranges from 200 to 300, 000 feet for the entire area. [SEP] obama's father's list of priorities is a short list at the top: chicago, ga., chicago, chicago,, chicago (r),... [SEP] s gordon, t chicago, b quinn, b m - t, s james, s - t, s hamilton. [SEP] 6, n. y. at cleveland, 10: 50 p. m. [SEP] the case of a 24 - year - old student, who said he has been charged, would be suspended in january for three weeks [SEP] + +===== sample 024 ===== +[CLS] days in the morning, then days, days, days, days, days, days, days, days in the early days, and then, days in the early days. [SEP] i've always thought, beginning to end, end to period to end,, to start,, more than end to start, to end to end, to end, to start to the road. [SEP] however, it seems that the planes have to go back to tomorrow, so the airlines would be making plans to hire more planes and return them in the afternoon and morning, the planes are not going to operate. [SEP] but, he said, [SEP] + +===== sample 025 ===== +[CLS] said. [SEP] the number was 50,, 50, and days. [SEP] on the basis of 50,,,,,,,,,,, 20 -,, and he, 10, 13, 7 - in. [SEP] i don't forget the numbers 50, 50, 50, and 50,,,, 50, 50, 50, 50, 49,, 37/sch, 98, 73, 98, 98, 98, 98, 89 of the other 50. [SEP] in reality, the former president has an excuse to go on the offensive yet, before the rest of the world is able to [SEP] + +===== sample 026 ===== +[CLS] in december. [SEP] i don't know what that was going on. [SEP] much of the roughly 33, 000 - mile - a - mile route is just over 3. 3 miles. [SEP] i'm staggered by the iranian government. [SEP] in the case of the program, the canadian astronaut, who in turn, was scheduled to begin working at the station on jan. [SEP] it's just the beginning of the healing process, " he said. [SEP] the celtics lost to chicago for the first time at home since the equivalent of a 1996 games in the olympic finals of chicago - - the first conference series game since the chicago [SEP] + +===== sample 027 ===== +[CLS] 89, 89,, 89, chicago's, 93, 95, 89, 89, 89, 89, 89,, 89, 89,, 89, 89, 89, 89,, 89, 90,, 89, 89, 89, etc. [SEP] in the meantime,,,,,,,,,,,,, and then, he's back again. [SEP] he wanted to talk and then told him to get back in there, "he said. [SEP]" we will know it's going to be, "he said." [SEP] instead, he's done in six days. [SEP] + +===== sample 028 ===== +[CLS], he has to turn up 50, 50,, 50, 60, 50, 50,, 50, 52 and day - to - day, day,, night,, and, day in a couple of days. "[SEP] the plane, which has been synonymous with history since the decades, came at the end of 2003, the last time the aircraft's planes crashed, but officials say the problem caused the air plane to stop at least a weeks later. [SEP]" if i read something, i don't think it will work, make a good point. [SEP] then,, and then,,, maybe, [SEP] + +===== sample 029 ===== +[CLS] to do with the game, but we do have to move from time to time. [SEP] in the end, most of the workers from michigan, michigan, michigan, texas, michigan and new jersey. [SEP] it was a shame, a good thing, a chance to be very good. [SEP] in the first week of the day, the celtics and the celtics, had the back - to - back - to games of the season. [SEP] it's a little late for end - of - the - road travellers, to return to quick, off - the - road access to the streets of london. [SEP] chicago, ohio ( ap [SEP] + +===== sample 030 ===== +[CLS] to the market. [SEP] to, to understand, to take back. [SEP] i do not know how much of a point of the road is to a little bump in the road, " he said, who asked to name the reason for that. [SEP] there is a need to dunk in the towel. [SEP] yes, there's a sense of desperation. [SEP] 1, october 22, october 16, 2006, october 14, dec. [SEP] i have to get up and walk on the road. [SEP] to finish,,, to finish... he is going to run,, to get down to make a turn, [SEP] + +===== sample 031 ===== +[CLS] in 2003. [SEP] "oh, chicago,, chicago - -,, chicago, chicago and, oh, you, chicago," said jordan and his brother, jordan, referring to the black - and - white team. [SEP] the planes - - small, small and small - - were delayed for several hours, he said. [SEP] its guest performers include willie golds, willie lewis and others (morris, willie jackson, wilson, james brown) during the past 50 years. [SEP] i would prefer the bread, however, it's fresh, so start the process, and put it on the boil, give it back. [SEP] + +===== sample 032 ===== +[CLS], then, be the neo - liberal, turn the line, say, "oh, oh, oh," she's okay, even if nothing, in the bill, they not cover the bill. [SEP] so, to remember to say, "to use the word," - - "use the word,," "prefix," "or whatever." [SEP] no matter, he said, it is so obvious that the burmese majority leader is still fighting a "dirty war." [SEP] it is a b,,,, y,, a,,,,,,,,,,,,, [SEP] + +===== sample 033 ===== +[CLS], 14 - 14, well ahead of the no. 9 - point mark. [SEP] but it is a joke. [SEP] that, the answer is, you know. [SEP] come on to go with a good friend and get back to work again. [SEP] " he is in a place to do things, this is just the way to make a relationship, the things to love, the things to want to do for all of us. [SEP] deutsche bahn has also said it wants to work better with the trade union and its transport workers. [SEP] detroit (ap) - as a top - seeded team in the national conference, the detroit tigers [SEP] + +===== sample 034 ===== +[CLS] the al - flyers, who joined the franchise in december 2008. [SEP] it is not day, time of period, period, time of season, time of change. [SEP] detroit, chicago, chicago,, chicago,, chicago, chicago, miami, chicago, indiana, chicago, chicago, new jersey, chicago, chicago, chicago, chicago,, chicago, chicago, us, chicago, chicago, chicago, chicago, ohio,, michigan,... [SEP] just add detroit, chicago, chicago, detroit, chicago, chicago. [SEP] but, however, if the new administration has time to reach a goal, it will be [SEP] + +===== sample 035 ===== +[CLS] to secure a series of back - to - back meetings with the yankees. [SEP] time,,,,,, change, period, re - start to get to work, and, eventually, to be done at the end of the year for other manufacturers. [SEP] for information, please contact the amex, u. s. department of the sec. [SEP] also, he is the conductor, who has to work from beginning to the end. [SEP] of the victims, only two were women. [SEP] chicago, in chicago, chicago, detroit, chicago, chicago, chicago, and chicago, the only city in order to receive the [SEP] + +===== sample 036 ===== +[CLS], s. 73 73, 75, 73, 100, 73 73, 71 73, 73, 73, 73, 73, 73, 73, 73, 73, 73, 73 and 73, 73, 70,, 73, etc. we are 65, 70 70, 73,, 73, 73,, and so. total of 60, 73, 73, 73, 73, 73, 73, 73, 73, 73, 70 54, 73, 54, 70 54, 73, 73, 73, 70 68, 73, 73, 73, 54., 51, 54, 54, 52, 73 [SEP] + +===== sample 037 ===== +[CLS] 37, 51, 542, 49, 49, 49, 48, 49, 49, 54, 54, 73, 73, 73, 73, 73, 73,, 159, 159, 159, 159, 159, 522, 528, 255, 365, 638, 737, 49, 49, 68, 49, 73, 73, 73, 73, 50, 73, 54, 76, 37, 37, 37, 45, 49. [SEP] the chrysler group, which belongs to an industrial association comprised of detroit, chicago, ohio,, chicago, and chicago and participates in the traditional alliance [SEP] + +===== sample 038 ===== +[CLS] thousands of dollars in 2002. [SEP] but the nets have had only three - - in 2002, 2004 and 2006, just before the playoffs. [SEP] the place of the wine is the destination, rather than the taste. [SEP] with the speed, the speed, the time lapse, the vertical area - - the gray area, and the vertical length of the 20 - year, period, the depth of the plane, the 15 -,, 12 -, -,,, 16 -,, 16 -,, and, and the combination of 15, 24, 30,,,,, 16 -,, 16 -, [SEP] + +===== sample 039 ===== +[CLS] games. [SEP] people seem to have forgotten that today, on the days of the day or not, the day is well after the day. [SEP] the amount of investment has to be ramped up to the point. [SEP] at the other end, mccain is trying to break the point. [SEP] had the team reached the end of the playoffs of 2002, it would have made the playoffs of 2007, the year, 2006, and, of the post - season, the year of the 2004 championship. [SEP] add to the fat - butter, add salt, salt and water to reach the other end of it. [SEP] the firm has already [SEP] + +===== sample 040 ===== +[CLS] they have to get out of the door. "[SEP] the planes, then, the need to day, day, day, and day - care approach to the ground. [SEP] it is also time for monday, november, december and october. [SEP]" we are just 0. 5 % at the moment. [SEP] in contrast, thomson, based in strasbourg, france, was closed for a week. [SEP] the 1996, 2004, are for the period, 2004,, 2003, 1997, 2003, 1997, 1996, 1997, 1981, 2004, and 2004, 2004, and the previous 2004, 2004,, and 2007 in the [SEP] + +===== sample 041 ===== +[CLS] - this time, to take the final step of their series to get to the postseason finals and reach the next playoffs. [SEP] in the first week of the year, 10, 15, 15, 14, 26, 26, 26, and in the last quarter, and,,,,,,,,, the whole pattern has been completed. [SEP] but in the end, i was,,,,, again,,,,,,,,,,,,,,,,,,, we will be seeing that again. [SEP] it is just pity, but for nothing. [SEP] lahka's [SEP] + +===== sample 042 ===== +[CLS] 50, 50, 15, 16, 18, 18, 14 - - and the numbers 50, 50, 49, 60, 17, 16, 36,, and so. [SEP] patrick croyle, 15, 21,, 21, 21, 37, 51, 37, 52, 37, 49,, 37,, 37,,,, 51,, 48, 37, 48,, 45,,,, 48, and 58. [SEP] in the uk,,, 48,,,, 52,, 54. [SEP] the week of the year, the sixth week of december, was the fourth - [SEP] + +===== sample 043 ===== +[CLS], 000, in the second quarter of 2008, and 40, 000 for the second quarter.... [SEP] 1, 2007, the year of december 2007, the two companies, in central michigan, illinois, chicago, michigan, massachusetts, to compete with the likes of michigan, michigan, michigan, chicago, ohio, michigan, michigan, illinois,, michigan, massachusetts, of course, and michigan, michigan and michigan, michigan. [SEP] the ism's new orders fell from 1997 to 98, the lowest monthly total since the start of the year, with the lowest total in 2006 - 07. [SEP] at least the [SEP] + +===== sample 044 ===== +[CLS]..... [SEP] in michigan, michigan, michigan, florida, michigan,,,, michigan, michigan, michigan,, michigan, ohio, michigan, 50,,, 50, 60,,,,,,, 50, 50,, 50, 70, 2, 1, 1, 2,, 4. [SEP] the numbers 14, 17, 26,,,, 11, 11, 13, 17, 15, 15, 11, 11, 14, 16, 15, 13, 14, 14. [SEP] the knicks, bulls, a lot of the fans, and the media, all all have [SEP] + +===== sample 045 ===== +[CLS]. [SEP] cover the potatoes in minutes,, and then, and,, but then, again, later in the day, and in the end. [SEP] it is time to the weather, the heat, the crowd, the presence of heat, lights, jets, jets, showers,, hopefully, the rest of the event. [SEP] 1, 2,,,,,, on the date,,,,,,,,, and, in a week with a range of 50, 000 to more. [SEP] the years 2000, 2003, 2004,, 2002, 2004, 2004, and 2004, respectively. here, [SEP] + +===== sample 046 ===== +[CLS], ohio, ohio, and cleveland, ohio. [SEP] 1997 - 98, chicago,, chicago, chicago, 1996, chicago, 1996 - 98, 1996, 1996,, 2000, 2004. the combination of, 89, 90, 1981, 1988 - 90,,,,,, 1985,,,,,, 89, and 98. [SEP] philadelphia (8 - 5) also got the second goal and four outs in a 2 - 2 victory, the longest - game - ever game. [SEP] in the midwest, chicago, michigan,, chicago, chicago, north carolina, chicago, chicago, chicago, st., [SEP] + +===== sample 047 ===== +[CLS] he said. [SEP] you would like to have a face - to - face meeting with the same team - - chicago, chicago, post - season meeting in a couple of weeks, etc. [SEP] he led the delegation to the conference centre of the british embassy. [SEP] but, there's time to prepare the pasta and make a stew. [SEP] 2008 - 2008 $7. 7 percent (2. 0), - $(13. 9) 8. 9 billion euros ( $17. 3 billion. [SEP] and all of that, in chicago, chicago, chicago, miami, miami, chicago, chicago, all of the [SEP] + +===== sample 048 ===== +[CLS] - - sometimes literally, sometimes in a trance, all in the same way that they tell us. [SEP] " now we can look at the numbers, we're going to make a big change at the moment. [SEP] then, then,, then, then, then, and then, it is the right thing to deal with. [SEP] on sunday, the white bulls will travel to the city for a road trip. [SEP] he led the first three batters, but the yankees and boston did the same in the first quarter. [SEP] chicago, chicago, chicago, chicago,, calgary, and chicago, oct. [SEP] the company [SEP] + +===== sample 049 ===== +[CLS]. [SEP] " he seems to be clever, he gets away with it, he needs to be more flexible, much more flexible... more than a, well, more than a, less clever. [SEP] in a statement to the conference board, dr james sanderson, regional director for the g & g - g schools and health organisation, said that the increase in additional loan commitments had an average value of $2. 6 million, up from $4. 9 million, at the year's end. [SEP] you will need a full trip -,,,,,, - - that comes later, not later, [SEP] + +===== sample 050 ===== +[CLS] would not seem to have it at the top. [SEP] the economy is back on the road, ok!..... you look, are we going to get it, leave it, end of the road?. [SEP] this time, day, day of the year, 50, 50, 52, 37, 52, and december. [SEP] the game is always in the middle and at the moment you have to be long enough to organize and take care of the right things. [SEP] on saturday, obama returned to kenya in a mood, a symbol of hope. [SEP] if they have managed to get back to a point of [SEP] + +===== sample 051 ===== +[CLS], 2003,, 1996, 1996, 1996, 2002, "he said. [SEP]" they have a two - week plan - - then they have a day and day and day and day and and then, and here, we have a team in the playoffs. [SEP] district attorney stephen patterson said he had no complaints about sampson. [SEP] single - family suvs are at the back - to - back games, chicago, chicago, chicago, chicago and other cities. [SEP] there he was in 1988, 1988, 1988, 1988, 1996, 1996, 1996, 1996, 1988, 1997, 2002 - - dispiriting the [SEP] + +===== sample 052 ===== +[CLS] the seasons 16, 14, 14, and 16. [SEP] the defendant, who's refused to grant such an order, told the court that two days earlier, he received about £100, 000. [SEP] i can't imagine that significant gains in housing - - and, small - value employment - - are in the deep recession. [SEP] december 14, 1893, u. s. troops, oct. [SEP] the nation's worst road game - - 14, 4, 000 - - was the worst game of the season. [SEP] for example, the firm said, 90 percent of single - and multi - family vehicles, which [SEP] + +===== sample 053 ===== +[CLS] for free, flights, flights - - and, in all, for the holidays. [SEP] the 6 - 15, 16, 17, 15, 15,, 18, 25,, 26, came to the end and 50, 50, and quit. [SEP] at that, he would have a year to live and a year to live. [SEP] however, bread and butter does not seem to lose its sparkle in the morning, so it is a good time to turn the boil on. [SEP] he spent a week with the dolphins in the chicago area, then turned twice in games to the bengals. [SEP] the first protests were started in [SEP] + +===== sample 054 ===== +[CLS] come from outside the united states, spokesman robert kelly said. [SEP] for example, the original path, the top - the - road, and the roof appeared on the back end, along with the entire back seat. [SEP] "the celtics took a face - to - face trip to a 14 - game series, back - to, back - and - forth. [SEP] in the second quarter, they beat the celtics, the chicago bulls, the chicago bears, so 0 - 1 that they went on to win - - either. [SEP] in atlanta, chicago, chicago, chicago, chicago, chicago, and again. [SEP]" the secret [SEP] + +===== sample 055 ===== +[CLS]. [SEP] 2. 13 - 2, detroit 7 - 11, detroit 11 - 1 - 2, detroit, s. chicago, detroit 11 - 14 - 1. 26 ). [SEP] the dow jones industrial index dropped by 2. 8 percentage points. [SEP] 18, 2007, is the "day of the year," she said. [SEP] the teams chicago, boston, chicago, boston,, and carolina - chicago. [SEP] however, the final games of the conference are teams in the playoffs, boston, chicago, chicago, chicago, detroit and chicago,, detroit, detroit, detroit and miami. [SEP] " the problem is that [SEP] + +===== sample 056 ===== +[CLS] in 50, 50, 60, 60,,,,,,,,,,,, 48, and was a key support for future operations. [SEP] total copies of the numbers are: men's 50, 73, 73, 73, 48,, 52, 52, 52, 52, 49, 48, 49, 52, 50, 52, 48, of the total, respectively. [SEP] the numbers 45, 37, 51, 51, 51, 51,,,,,, 18,,,, 18, 37, 37, 37, 37, 37, 37, 37, 52,, 48 [SEP] + +===== sample 057 ===== +[CLS] in turn. the time with the rest of week - - to - back. to - back - to - back, late - milan - to - boston - again, afternoon - late - night days. [SEP] period days, 36, 36, 27, 26, 37, 37, 37, 31, 37, 37, 45, - 48, 48, 52, 51, 48, 48, 48.... days, 36, days to take over all of the days, december, december,, 38, 36, days to end up with ice - in days, then sit down on the ice. [SEP] he [SEP] + +===== sample 058 ===== +[CLS] s., chicago,, chicago,, chicago. [SEP] 8, 14, 2009. [SEP] the worst of the recession is, as a result, the worst of the global downturn. [SEP] take a bottle of the water, the water, the wine, the bread, the milk bottle, the office, the office. [SEP] numbers of, 15, 16,, 13, 15, 17, 17,, 15, 15,, 15, 31,, 15, 15, 21, 18,, 18, 23, 24,, etc., 13, 18, 24,,,,,,,,, [SEP] + +===== sample 059 ===== +[CLS] rules in order to comply. [SEP] finally, the moment of relief was one to away. [SEP] and there are more than, think, of, a very few things. [SEP] for now, the cavaliers are back in the lead - -, perhaps, even in the playoffs, though. [SEP] but instead of winning detroit, detroit, miami, detroit's - - 14 win at atlanta - - the broncos took their season on top. [SEP] "in the face of a recession, it is hard to get the economy back to the ground, to get close enough to dry up in the near term," said the u. s [SEP] + +===== sample 060 ===== +[CLS] health care. [SEP] the movement in the system is the product of short - term, not short - term ideology. [SEP] he will make, sell, design,, service,, sell, service, and produce, a furniture, kitchen, bakery and services company. [SEP] the problem is similar to the stadium that was built a week after the incident, which came after a 17 - 14 win, 38 - 14 loss in the city. [SEP] this is the amount of warmth and sense of warmth and emotional closeness. [SEP] los angeles - if james brown isn't even back in a playoff situation, the cleveland magic can move on to [SEP] + +===== sample 061 ===== +[CLS] flight in chicago, and then a private flight to chicago, and a flight from chicago. [SEP] on monday, the president will travel to the capital to lay a three - year wreath on the road to a peace agreement. [SEP] it then translates to 14, 18, 50, 50, and so. [SEP] i have to wait in london for a number of days, week, week - - and he's 50, 50, 50, 50, 50. [SEP] he will never have anything. [SEP] it is chicago, chicago, chicago, chicago, chicago, and chicago. [SEP] the midwest region, michigan, chicago, texas, [SEP] + +===== sample 062 ===== +[CLS] itself as the "mother of hope." [SEP] the rally marked the end of a five - year trend as it turned to the mid - term. [SEP] on a, 14, 16, 16,, 15, 14 - - on a 10, 15, 15, 16,, 16,, 18, 24, at the end - - he seemed to make a point of himself. [SEP] that is a mark of weakness. [SEP] the pillars of the building's roof were blown up. [SEP] after the diagnosis, i came back to the hospital to see that i would have a doctor on the way to the hospital. [SEP] [SEP] + +===== sample 063 ===== +[CLS] $150 a ton, about 20 percent of the original cost. [SEP] i would provide an answer to your right question. [SEP] it might well be okay to eat, but not want to go to sleep in front of the sofa. [SEP] in 1919, on the fourth day of december, he died in the palace hotel in london. [SEP] he was returned to the courtroom and in the process had to make the case back again. [SEP] weeks,, weeks,, weeks, or months. [SEP] 21, 2007, when south dakota state police chief jim brown said he made a decision to buy the plane. [SEP] " it's a [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/state_c1024_t1p45_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/state_c1024_t1p45_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..08fc5f35625f94b3e237cf4a1e88670e35d52db4 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/state_c1024_t1p45_raw_samples.txt @@ -0,0 +1,228 @@ +state_c1024_t1p45 +{ + "type": "summary", + "name": "state_c1024_t1p45", + "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", + "step": 124000, + "decode": { + "kind": "categorical_fullvocab", + "config": "state_c1024_t1p45", + "steps": 32, + "model_t_mode": "post", + "support_power": 1.0, + "semantic_power": 1.0, + "endpoint_temp": 1.45, + "concentration_min": 1.0, + "concentration_max": 1024.0, + "final_from": "state", + "update": "resample", + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 31.13635173493272, + "nll_per_token": 3.438376002668099, + "tokens": 9165 + }, + "diversity": { + "sample_entropy": 3.3146319833825286, + "unique_tokens": 1102, + "token_count": 8192, + "distinct_1": 0.134521484375, + "distinct_2": 0.4309793307086614, + "top_token_mass": 0.2288818359375 + } +} + +===== sample 000 ===== +[CLS] at the end of a deal. [SEP] science has found that it is true and makes no sense........ to back - to - back, 50, 50 to - 50, 50, 37, 48, 45, 45, and 52. [SEP] " there was no time, on the same day, at the same time, no days, even days, just seven days, i do, " he said. [SEP] he did not even let me dwell on the challenges of that... [SEP] we ' ll vote for obama.... [SEP] the meeting, called for monday afternoon, is to [SEP] + +===== sample 001 ===== +[CLS] 25, 40, 50, 50, 50, 60, 60, and the same period, when the hawks ' worst record was 14 - 14. [SEP] asheville, n. d., studied at the university of ohio, ohio, illinois university, ohio, texas, illinois, canada, ireland, the university of carolina and canada. [SEP] " i think he has an option, " romo said. [SEP] if the person is really prepared to do the job, this is a new beginning. [SEP] the group raised $ 16. 7 million in obama ' s first three days of campaign. [SEP] he ended a two - game [SEP] + +===== sample 002 ===== +[CLS] - - - flights of 2, 07,, 07, and in for at least five hours - -,,,,,, 45,,, 52. [SEP] at the end of the day, he said, the pilot still managed to retrieve the severed parts of the plane. [SEP] in other cases, the combination of warmth and warmth. [SEP] the political leader has raised his official concern about the war in the time of the election as being " ridiculous. " [SEP] now, they would like to have a child with a doctor to get just a bit in the right room. [SEP] he then emerged from the balcony of the building [SEP] + +===== sample 003 ===== +[CLS] of the period, period prior to making a decision, a period, period, period,,,,, period, period, period,,,,, day, period, day, period,, period,,,,,,, period, period. [SEP] and so, the period,, period, period, period,,,,,, period,,,,,,,,, period,,, period, period, period,, period, period, period,,,,,,, and period, the day is days, days, period, period, period, period,,,, [SEP] + +===== sample 004 ===== +[CLS] century - old building. [SEP] " we have a lot of back - game games but, i remember, we have not had a game since 2003, " he said. [SEP] instead, after 1914 and 1868, the convention to collapse in power led to the collapse of british communism. [SEP] " the peak - to -, peak - to - - to - trough period... the days of december 1988, beginning in 1988, to - back - to - back period, and 1988, and december 2007, and,,,,, 1996, 1997,,,,, and, 2003, " he said. [SEP] he [SEP] + +===== sample 005 ===== +[CLS] december 16, 2008 in chicago. [SEP] kiwis is out for two months, days, weeks,, in the week to week, - -, week, week, week, week,, and week. [SEP] the bears are to face a series in chicago on - 16, dec. [SEP] he is going to be out of town for an interview. [SEP] boston, detroit 11 - 16, 11 - 11,, 11, and 11 - - to complete season - to - season winnings. [SEP] in his first year at the school, he died. [SEP] a group of protesters in the capital opened the door for its [SEP] + +===== sample 006 ===== +[CLS] 21. 50. [SEP] obama says, days, days, days, in the morning, in the morning, and time to date these days, week, day, week,,, period. [SEP] the three - break began over a 15 - day period, a week of the end of the day and the rest of the night ' s day in the afternoon. [SEP] from three days, in the first quarter, to the next, 4, 4, 6, 8, 8, 11, and and, to the end of 2008. [SEP] the atlantis v, a space plane, is scheduled to take off at 7 : 15 [SEP] + +===== sample 007 ===== +[CLS] said. [SEP] " we could say, it ' s the time to talk of bankruptcy, " said said robert woodley, the president of the national automobile trade association of america, which organizes the union. [SEP] in the u. s., flights begin to 3, 000, 000 feet at the start of the day and increase to more than 30 -, -, -, -, -, -, -, -, 1, 000 - -. [SEP] notes : @ 4 - 4, detroit 0, calgary 0 - 6 - 2 - 2... [SEP] on december 14, 25, 2006, of the 91 [SEP] + +===== sample 008 ===== +[CLS] 13 - year - old. [SEP] face - by - face, after all, at the end of her life, she was given time to time, time to time, time to time to time again. [SEP] now, the economy is in - - and in the future. [SEP] the two season series of games in cleveland, which is on june of - 14 in boston, the road series in atlanta and the game of the best - of - five series in san francisco. [SEP] finally, the bill of purchase was passed to the cpcb and the queen ' s for the period of which amounts to 100 days, respectively. [SEP] [SEP] + +===== sample 009 ===== +[CLS],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and, in the first half of the year. [SEP] 13,, 14, 15, 15, 15, 30, and 4, 52... [SEP] of course, the team is completely out of place,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, of the year,,,,,,,,,,,,,, and,. [SEP] he [SEP] + +===== sample 010 ===== +[CLS]9. 50 per person, including for a day - to - school stay. [SEP] it is expected to be 65,,,,,,,, 45, 51, 48,, 48, 48, 37, 48, 48. [SEP] the company ' s firm ' s list of operations in the trade is expected to include : 50,, 50, 60, 60, 50,, 50, 50,,,, 36,,,,,,,,,,,,,,,,,,, etc. [SEP] if the jets were to show in depth, the teams would be ready to move, [SEP] + +===== sample 011 ===== +[CLS] said he was given the opportunity to play in the olympics so far. [SEP] 51, 48 and it ' s day,,,,, day - - there ' ll be people to move,,,,,,,,,,,,,,, 48,, 48, 36,, 27,, 48,,,,,,,,,,, 48,,,, 48, the rest. [SEP] from the field,,,,,,, 49, 48, 49, 52, 54, seems to make the most of the woes,,,,,,,,,, [SEP] + +===== sample 012 ===== +[CLS] you can see that the author has a bit of scented cake, the scented fruit has an awful scented curse on the table. [SEP] in fact, the results will come soon, not even later. [SEP] the meeting was in fact a year away. [SEP] and then, more than 1, 200 passengers, including passengers, had to return to the airport monday morning to begin the 12 - hour stopover. [SEP] we have to talk come, come, break, we have to talk. [SEP] once they do, they will be able to feel, and when they do not feel back, they will feel more of a shock. [SEP] the [SEP] + +===== sample 013 ===== +[CLS] the rest of the 2004 - 7, including the back - to - back trip to the playoffs. [SEP] detroit 7, minnesota 27, 26, chicago,, cleveland,, chicago,, 50 - 48. - for the week, dec. - 60, 50 - 73, 50 - 73, 50 - 50, and beyond. - - 50 - 50, 37, 50, 50, 50, 50, parts of 50 - 49, 50 - 45, 60 - 50, in new york, boston 37, 50, boston 48, 50 - 50, 52, 60 - 60 and 48. - -,,, [SEP] + +===== sample 014 ===== +[CLS] we have to do it all together. [SEP] the man,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, to grow - up to his, and, oh, he opened his eyes at the end of the journey, and " no one wants to be sure what he wants to be, " he said. [SEP] however, the current period was about a year earlier and is much longer. [SEP] the guy who will, he said, make the tens of thousands of dollars. [SEP] " i think they have to do it again. [SEP] [SEP] + +===== sample 015 ===== +[CLS] good friend, not a woman,, sits in the back of the house, but has not been wearing an eye. [SEP] chicago, september 11, 2008, and chicago, dec. [SEP] of course, 50,, 50, 60, by the end of........ 60, 50, 50, and in the end, they want to be. [SEP] with more than a week left after tuesday ' s quake, trucks and dump piled with hundreds of cars and collapsed on the roofs of government buildings. [SEP] " i was the first person to give me something to play during the day, " he said [SEP] + +===== sample 016 ===== +[CLS]. [SEP] with the examples above, it would be time to have a good day in 2009. [SEP] the flight crew, miraculously, took the way to the airport and then returned to the prison area for their rescue. [SEP] a few years after being introduced to saba, he is on the field, and he will be a highlight of the day. [SEP] the european transport committee has already provided such help. [SEP] rondo, who has 22, 13 assists and eight assists this season, scored seven straight points. [SEP] 11, not again, but for the first time in 13 days. [SEP] today, december 21, 2007, [SEP] + +===== sample 017 ===== +[CLS], the met ' s co - artistic director. [SEP] her goal was to have that the rest of her life, writing letters to read, arranging, and, sometimes, to write poems. [SEP] the period : 2 - 2 _ detroit 18, chicago 7, detroit - - bay, chicago, detroit 20 ( 4. 36 pp ). [SEP] according to the survey, back to 2003, it came to nothing. [SEP] for some reason, the colts lost the series to detroit, too. [SEP] " i feel sorry, and he seems to have to look for that, " she said. [SEP] a few years later, however, [SEP] + +===== sample 018 ===== +[CLS] cent in december, the current reduction of 3. 8 to - 4. 9 per cent. [SEP] days of the past few days, days, days, days days to get in. days by the same week, days, week, week. [SEP] chicago - he ' s 50, 73, 73, 73, 73, 73, 73... [SEP] of course, after 50, 60, 65, they just are working days, days, weeks, and.. [SEP] vanilla, textured vanilla, chocolate - vanilla, sweet vanilla, sugared, vanilla, and salted, anded, at the start of the [SEP] + +===== sample 019 ===== +[CLS] - 15, 18, 15, 16, 16, 16,, 16, 18, and then,. 13, 1 - 18, 1 - 3, 14 - 15, 26, 26, 16, 18,,,, 16,,, 16, 16,, 13 - 16, 16 - 17, at about 0630 bst on december 7. [SEP] the magic led, 51 - 48, charlotte, chicago, ( 25 - 14, 16 - 16, 16 - 14 ). [SEP] i have to say you have a chance to breathe, tim. [SEP] the man, a wavy, hefty black [SEP] + +===== sample 020 ===== +[CLS] period - to - period for the day, period, period, period, period, time to start, period, - - to the end, period, period, day, day,, in the period,, with debrinks and day, period. [SEP] he said the planes were period, 50 -,,,,,,,,,,, 30 - and 50 - to weeks. [SEP] mr brown said that the meeting was full, normally, and that he had been assigned to the site to participate in training hours. [SEP] " we ' ve cut back from week to week to week to, " he [SEP] + +===== sample 021 ===== +[CLS] the first quarter, 1991 and 1996. [SEP] in the pre - trade agreement, the teams chicago, chicago, chicago, chicago, chicago, new york, chicago, chicago and detroit, which has chicago in chicago, called the city council, which specializes in the cities of chicago, chicago, chicago and chicago, a " chicago alliance. " [SEP] the children are not expected to appear for about 15 minutes. [SEP] " for now, we ' ve been told, the stock is not going to come down, " mchaeag said. [SEP] we ' ll wait a little while to see the end come time after time again. [SEP] [SEP] + +===== sample 022 ===== +[CLS], gordon ( 54 ), blaney ( detroit, 54 ). [SEP] in a typical time period, at half - time, the period period, period, 50,, 40,, 50,, 50, 60, 50, and 52. [SEP] we are not a dog,, to have a dog,,,, to have a dog. [SEP] meanwhile, if we have built a universe of opportunity - - 50 years or less - - then the vision of social mobility will become even more profound - - just when you know days, days,, days, days, days,,,,,,,, [SEP] + +===== sample 023 ===== +[CLS] into different areas of the city, which ranges from 200 to 300, 000 feet for the entire area. [SEP] obama ' s father ' s list of priorities is a short list at the top : chicago, ga., chicago, chicago,, chicago ( r ),... [SEP] s gordon, t chicago, b quinn, b m - t, s james, s - t, s hamilton. [SEP] 6, n. y. at cleveland, 10 : 50 p. m. [SEP] the case of a 24 - year - old student, who said he has been charged, would be suspended in january for three weeks [SEP] + +===== sample 024 ===== +[CLS] days in the morning, then days, days, days, days, days, days, days, days in the early days, and then, days in the early days. [SEP] i ' ve always thought, beginning to end, end to period to end,, to start,, more than end to start, to end to end, to end, to start to the road. [SEP] however, it seems that the planes have to go back to tomorrow, so the airlines would be making plans to hire more planes and return them in the afternoon and morning, the planes are not going to operate. [SEP] but, he said, [SEP] + +===== sample 025 ===== +[CLS] said. [SEP] the number was 50,, 50, and days. [SEP] on the basis of 50,,,,,,,,,,, 20 -,, and he, 10, 13, 7 - in. [SEP] i don ' t forget the numbers 50, 50, 50, and 50,,,, 50, 50, 50, 50, 49,, 37 / sch, 98, 73, 98, 98, 98, 98, 89 of the other 50. [SEP] in reality, the former president has an excuse to go on the offensive yet, before the rest of the world is able to [SEP] + +===== sample 026 ===== +[CLS] in december. [SEP] i don ' t know what that was going on. [SEP] much of the roughly 33, 000 - mile - a - mile route is just over 3. 3 miles. [SEP] i ' m staggered by the iranian government. [SEP] in the case of the program, the canadian astronaut, who in turn, was scheduled to begin working at the station on jan. [SEP] it ' s just the beginning of the healing process, " he said. [SEP] the celtics lost to chicago for the first time at home since the equivalent of a 1996 games in the olympic finals of chicago - - the first conference series game since the chicago [SEP] + +===== sample 027 ===== +[CLS] 89, 89,, 89, chicago ' s, 93, 95, 89, 89, 89, 89, 89,, 89, 89,, 89, 89, 89, 89,, 89, 90,, 89, 89, 89, etc. [SEP] in the meantime,,,,,,,,,,,,, and then, he ' s back again. [SEP] he wanted to talk and then told him to get back in there, " he said. [SEP] " we will know it ' s going to be, " he said. " [SEP] instead, he ' s done in six days. [SEP] + +===== sample 028 ===== +[CLS], he has to turn up 50, 50,, 50, 60, 50, 50,, 50, 52 and day - to - day, day,, night,, and, day in a couple of days. " [SEP] the plane, which has been synonymous with history since the decades, came at the end of 2003, the last time the aircraft ' s planes crashed, but officials say the problem caused the air plane to stop at least a weeks later. [SEP] " if i read something, i don ' t think it will work, make a good point. [SEP] then,, and then,,, maybe, [SEP] + +===== sample 029 ===== +[CLS] to do with the game, but we do have to move from time to time. [SEP] in the end, most of the workers from michigan, michigan, michigan, texas, michigan and new jersey. [SEP] it was a shame, a good thing, a chance to be very good. [SEP] in the first week of the day, the celtics and the celtics, had the back - to - back - to games of the season. [SEP] it ' s a little late for end - of - the - road travellers, to return to quick, off - the - road access to the streets of london. [SEP] chicago, ohio ( ap [SEP] + +===== sample 030 ===== +[CLS] to the market. [SEP] to, to understand, to take back. [SEP] i do not know how much of a point of the road is to a little bump in the road, " he said, who asked to name the reason for that. [SEP] there is a need to dunk in the towel. [SEP] yes, there ' s a sense of desperation. [SEP] 1, october 22, october 16, 2006, october 14, dec. [SEP] i have to get up and walk on the road. [SEP] to finish,,, to finish... he is going to run,, to get down to make a turn, [SEP] + +===== sample 031 ===== +[CLS] in 2003. [SEP] " oh, chicago,, chicago - -,, chicago, chicago and, oh, you, chicago, " said jordan and his brother, jordan, referring to the black - and - white team. [SEP] the planes - - small, small and small - - were delayed for several hours, he said. [SEP] its guest performers include willie golds, willie lewis and others ( morris, willie jackson, wilson, james brown ) during the past 50 years. [SEP] i would prefer the bread, however, it ' s fresh, so start the process, and put it on the boil, give it back. [SEP] + +===== sample 032 ===== +[CLS], then, be the neo - liberal, turn the line, say, " oh, oh, oh, " she ' s okay, even if nothing, in the bill, they not cover the bill. [SEP] so, to remember to say, " to use the word, " - - " use the word,, " " prefix, " " or whatever. " [SEP] no matter, he said, it is so obvious that the burmese majority leader is still fighting a " dirty war. " [SEP] it is a b,,,, y,, a,,,,,,,,,,,,, [SEP] + +===== sample 033 ===== +[CLS], 14 - 14, well ahead of the no. 9 - point mark. [SEP] but it is a joke. [SEP] that, the answer is, you know. [SEP] come on to go with a good friend and get back to work again. [SEP] " he is in a place to do things, this is just the way to make a relationship, the things to love, the things to want to do for all of us. [SEP] deutsche bahn has also said it wants to work better with the trade union and its transport workers. [SEP] detroit ( ap ) - as a top - seeded team in the national conference, the detroit tigers [SEP] + +===== sample 034 ===== +[CLS] the al - flyers, who joined the franchise in december 2008. [SEP] it is not day, time of period, period, time of season, time of change. [SEP] detroit, chicago, chicago,, chicago,, chicago, chicago, miami, chicago, indiana, chicago, chicago, new jersey, chicago, chicago, chicago, chicago,, chicago, chicago, us, chicago, chicago, chicago, chicago, ohio,, michigan,... [SEP] just add detroit, chicago, chicago, detroit, chicago, chicago. [SEP] but, however, if the new administration has time to reach a goal, it will be [SEP] + +===== sample 035 ===== +[CLS] to secure a series of back - to - back meetings with the yankees. [SEP] time,,,,,, change, period, re - start to get to work, and, eventually, to be done at the end of the year for other manufacturers. [SEP] for information, please contact the amex, u. s. department of the sec. [SEP] also, he is the conductor, who has to work from beginning to the end. [SEP] of the victims, only two were women. [SEP] chicago, in chicago, chicago, detroit, chicago, chicago, chicago, and chicago, the only city in order to receive the [SEP] + +===== sample 036 ===== +[CLS], s. 73 73, 75, 73, 100, 73 73, 71 73, 73, 73, 73, 73, 73, 73, 73, 73, 73, 73 and 73, 73, 70,, 73, etc. we are 65, 70 70, 73,, 73, 73,, and so. total of 60, 73, 73, 73, 73, 73, 73, 73, 73, 73, 70 54, 73, 54, 70 54, 73, 73, 73, 70 68, 73, 73, 73, 54., 51, 54, 54, 52, 73 [SEP] + +===== sample 037 ===== +[CLS] 37, 51, 542, 49, 49, 49, 48, 49, 49, 54, 54, 73, 73, 73, 73, 73, 73,, 159, 159, 159, 159, 159, 522, 528, 255, 365, 638, 737, 49, 49, 68, 49, 73, 73, 73, 73, 50, 73, 54, 76, 37, 37, 37, 45, 49. [SEP] the chrysler group, which belongs to an industrial association comprised of detroit, chicago, ohio,, chicago, and chicago and participates in the traditional alliance [SEP] + +===== sample 038 ===== +[CLS] thousands of dollars in 2002. [SEP] but the nets have had only three - - in 2002, 2004 and 2006, just before the playoffs. [SEP] the place of the wine is the destination, rather than the taste. [SEP] with the speed, the speed, the time lapse, the vertical area - - the gray area, and the vertical length of the 20 - year, period, the depth of the plane, the 15 -,, 12 -, -,,, 16 -,, 16 -,, and, and the combination of 15, 24, 30,,,,, 16 -,, 16 -, [SEP] + +===== sample 039 ===== +[CLS] games. [SEP] people seem to have forgotten that today, on the days of the day or not, the day is well after the day. [SEP] the amount of investment has to be ramped up to the point. [SEP] at the other end, mccain is trying to break the point. [SEP] had the team reached the end of the playoffs of 2002, it would have made the playoffs of 2007, the year, 2006, and, of the post - season, the year of the 2004 championship. [SEP] add to the fat - butter, add salt, salt and water to reach the other end of it. [SEP] the firm has already [SEP] + +===== sample 040 ===== +[CLS] they have to get out of the door. " [SEP] the planes, then, the need to day, day, day, and day - care approach to the ground. [SEP] it is also time for monday, november, december and october. [SEP] " we are just 0. 5 % at the moment. [SEP] in contrast, thomson, based in strasbourg, france, was closed for a week. [SEP] the 1996, 2004, are for the period, 2004,, 2003, 1997, 2003, 1997, 1996, 1997, 1981, 2004, and 2004, 2004, and the previous 2004, 2004,, and 2007 in the [SEP] + +===== sample 041 ===== +[CLS] - this time, to take the final step of their series to get to the postseason finals and reach the next playoffs. [SEP] in the first week of the year, 10, 15, 15, 14, 26, 26, 26, and in the last quarter, and,,,,,,,,, the whole pattern has been completed. [SEP] but in the end, i was,,,,, again,,,,,,,,,,,,,,,,,,, we will be seeing that again. [SEP] it is just pity, but for nothing. [SEP] lahka ' s [SEP] + +===== sample 042 ===== +[CLS] 50, 50, 15, 16, 18, 18, 14 - - and the numbers 50, 50, 49, 60, 17, 16, 36,, and so. [SEP] patrick croyle, 15, 21,, 21, 21, 37, 51, 37, 52, 37, 49,, 37,, 37,,,, 51,, 48, 37, 48,, 45,,,, 48, and 58. [SEP] in the uk,,, 48,,,, 52,, 54. [SEP] the week of the year, the sixth week of december, was the fourth - [SEP] + +===== sample 043 ===== +[CLS], 000, in the second quarter of 2008, and 40, 000 for the second quarter.... [SEP] 1, 2007, the year of december 2007, the two companies, in central michigan, illinois, chicago, michigan, massachusetts, to compete with the likes of michigan, michigan, michigan, chicago, ohio, michigan, michigan, illinois,, michigan, massachusetts, of course, and michigan, michigan and michigan, michigan. [SEP] the ism ' s new orders fell from 1997 to 98, the lowest monthly total since the start of the year, with the lowest total in 2006 - 07. [SEP] at least the [SEP] + +===== sample 044 ===== +[CLS]..... [SEP] in michigan, michigan, michigan, florida, michigan,,,, michigan, michigan, michigan,, michigan, ohio, michigan, 50,,, 50, 60,,,,,,, 50, 50,, 50, 70, 2, 1, 1, 2,, 4. [SEP] the numbers 14, 17, 26,,,, 11, 11, 13, 17, 15, 15, 11, 11, 14, 16, 15, 13, 14, 14. [SEP] the knicks, bulls, a lot of the fans, and the media, all all have [SEP] + +===== sample 045 ===== +[CLS]. [SEP] cover the potatoes in minutes,, and then, and,, but then, again, later in the day, and in the end. [SEP] it is time to the weather, the heat, the crowd, the presence of heat, lights, jets, jets, showers,, hopefully, the rest of the event. [SEP] 1, 2,,,,,, on the date,,,,,,,,, and, in a week with a range of 50, 000 to more. [SEP] the years 2000, 2003, 2004,, 2002, 2004, 2004, and 2004, respectively. here, [SEP] + +===== sample 046 ===== +[CLS], ohio, ohio, and cleveland, ohio. [SEP] 1997 - 98, chicago,, chicago, chicago, 1996, chicago, 1996 - 98, 1996, 1996,, 2000, 2004. the combination of, 89, 90, 1981, 1988 - 90,,,,,, 1985,,,,,, 89, and 98. [SEP] philadelphia ( 8 - 5 ) also got the second goal and four outs in a 2 - 2 victory, the longest - game - ever game. [SEP] in the midwest, chicago, michigan,, chicago, chicago, north carolina, chicago, chicago, chicago, st., [SEP] + +===== sample 047 ===== +[CLS] he said. [SEP] you would like to have a face - to - face meeting with the same team - - chicago, chicago, post - season meeting in a couple of weeks, etc. [SEP] he led the delegation to the conference centre of the british embassy. [SEP] but, there ' s time to prepare the pasta and make a stew. [SEP] 2008 - 2008 $ 7. 7 percent ( 2. 0 ), - $ ( 13. 9 ) 8. 9 billion euros ( $ 17. 3 billion. [SEP] and all of that, in chicago, chicago, chicago, miami, miami, chicago, chicago, all of the [SEP] + +===== sample 048 ===== +[CLS] - - sometimes literally, sometimes in a trance, all in the same way that they tell us. [SEP] " now we can look at the numbers, we ' re going to make a big change at the moment. [SEP] then, then,, then, then, then, and then, it is the right thing to deal with. [SEP] on sunday, the white bulls will travel to the city for a road trip. [SEP] he led the first three batters, but the yankees and boston did the same in the first quarter. [SEP] chicago, chicago, chicago, chicago,, calgary, and chicago, oct. [SEP] the company [SEP] + +===== sample 049 ===== +[CLS]. [SEP] " he seems to be clever, he gets away with it, he needs to be more flexible, much more flexible... more than a, well, more than a, less clever. [SEP] in a statement to the conference board, dr james sanderson, regional director for the g & g - g schools and health organisation, said that the increase in additional loan commitments had an average value of $ 2. 6 million, up from $ 4. 9 million, at the year ' s end. [SEP] you will need a full trip -,,,,,, - - that comes later, not later, [SEP] + +===== sample 050 ===== +[CLS] would not seem to have it at the top. [SEP] the economy is back on the road, ok!..... you look, are we going to get it, leave it, end of the road?. [SEP] this time, day, day of the year, 50, 50, 52, 37, 52, and december. [SEP] the game is always in the middle and at the moment you have to be long enough to organize and take care of the right things. [SEP] on saturday, obama returned to kenya in a mood, a symbol of hope. [SEP] if they have managed to get back to a point of [SEP] + +===== sample 051 ===== +[CLS], 2003,, 1996, 1996, 1996, 2002, " he said. [SEP] " they have a two - week plan - - then they have a day and day and day and day and and then, and here, we have a team in the playoffs. [SEP] district attorney stephen patterson said he had no complaints about sampson. [SEP] single - family suvs are at the back - to - back games, chicago, chicago, chicago, chicago and other cities. [SEP] there he was in 1988, 1988, 1988, 1988, 1996, 1996, 1996, 1996, 1988, 1997, 2002 - - dispiriting the [SEP] + +===== sample 052 ===== +[CLS] the seasons 16, 14, 14, and 16. [SEP] the defendant, who ' s refused to grant such an order, told the court that two days earlier, he received about £100, 000. [SEP] i can ' t imagine that significant gains in housing - - and, small - value employment - - are in the deep recession. [SEP] december 14, 1893, u. s. troops, oct. [SEP] the nation ' s worst road game - - 14, 4, 000 - - was the worst game of the season. [SEP] for example, the firm said, 90 percent of single - and multi - family vehicles, which [SEP] + +===== sample 053 ===== +[CLS] for free, flights, flights - - and, in all, for the holidays. [SEP] the 6 - 15, 16, 17, 15, 15,, 18, 25,, 26, came to the end and 50, 50, and quit. [SEP] at that, he would have a year to live and a year to live. [SEP] however, bread and butter does not seem to lose its sparkle in the morning, so it is a good time to turn the boil on. [SEP] he spent a week with the dolphins in the chicago area, then turned twice in games to the bengals. [SEP] the first protests were started in [SEP] + +===== sample 054 ===== +[CLS] come from outside the united states, spokesman robert kelly said. [SEP] for example, the original path, the top - the - road, and the roof appeared on the back end, along with the entire back seat. [SEP] " the celtics took a face - to - face trip to a 14 - game series, back - to, back - and - forth. [SEP] in the second quarter, they beat the celtics, the chicago bulls, the chicago bears, so 0 - 1 that they went on to win - - either. [SEP] in atlanta, chicago, chicago, chicago, chicago, chicago, and again. [SEP] " the secret [SEP] + +===== sample 055 ===== +[CLS]. [SEP] 2. 13 - 2, detroit 7 - 11, detroit 11 - 1 - 2, detroit, s. chicago, detroit 11 - 14 - 1. 26 ). [SEP] the dow jones industrial index dropped by 2. 8 percentage points. [SEP] 18, 2007, is the " day of the year, " she said. [SEP] the teams chicago, boston, chicago, boston,, and carolina - chicago. [SEP] however, the final games of the conference are teams in the playoffs, boston, chicago, chicago, chicago, detroit and chicago,, detroit, detroit, detroit and miami. [SEP] " the problem is that [SEP] + +===== sample 056 ===== +[CLS] in 50, 50, 60, 60,,,,,,,,,,,, 48, and was a key support for future operations. [SEP] total copies of the numbers are : men ' s 50, 73, 73, 73, 48,, 52, 52, 52, 52, 49, 48, 49, 52, 50, 52, 48, of the total, respectively. [SEP] the numbers 45, 37, 51, 51, 51, 51,,,,,, 18,,,, 18, 37, 37, 37, 37, 37, 37, 37, 52,, 48 [SEP] + +===== sample 057 ===== +[CLS] in turn. the time with the rest of week - - to - back. to - back - to - back, late - milan - to - boston - again, afternoon - late - night days. [SEP] period days, 36, 36, 27, 26, 37, 37, 37, 31, 37, 37, 45, - 48, 48, 52, 51, 48, 48, 48.... days, 36, days to take over all of the days, december, december,, 38, 36, days to end up with ice - in days, then sit down on the ice. [SEP] he [SEP] + +===== sample 058 ===== +[CLS] s., chicago,, chicago,, chicago. [SEP] 8, 14, 2009. [SEP] the worst of the recession is, as a result, the worst of the global downturn. [SEP] take a bottle of the water, the water, the wine, the bread, the milk bottle, the office, the office. [SEP] numbers of, 15, 16,, 13, 15, 17, 17,, 15, 15,, 15, 31,, 15, 15, 21, 18,, 18, 23, 24,, etc., 13, 18, 24,,,,,,,,, [SEP] + +===== sample 059 ===== +[CLS] rules in order to comply. [SEP] finally, the moment of relief was one to away. [SEP] and there are more than, think, of, a very few things. [SEP] for now, the cavaliers are back in the lead - -, perhaps, even in the playoffs, though. [SEP] but instead of winning detroit, detroit, miami, detroit ' s - - 14 win at atlanta - - the broncos took their season on top. [SEP] " in the face of a recession, it is hard to get the economy back to the ground, to get close enough to dry up in the near term, " said the u. s [SEP] + +===== sample 060 ===== +[CLS] health care. [SEP] the movement in the system is the product of short - term, not short - term ideology. [SEP] he will make, sell, design,, service,, sell, service, and produce, a furniture, kitchen, bakery and services company. [SEP] the problem is similar to the stadium that was built a week after the incident, which came after a 17 - 14 win, 38 - 14 loss in the city. [SEP] this is the amount of warmth and sense of warmth and emotional closeness. [SEP] los angeles - if james brown isn ' t even back in a playoff situation, the cleveland magic can move on to [SEP] + +===== sample 061 ===== +[CLS] flight in chicago, and then a private flight to chicago, and a flight from chicago. [SEP] on monday, the president will travel to the capital to lay a three - year wreath on the road to a peace agreement. [SEP] it then translates to 14, 18, 50, 50, and so. [SEP] i have to wait in london for a number of days, week, week - - and he ' s 50, 50, 50, 50, 50. [SEP] he will never have anything. [SEP] it is chicago, chicago, chicago, chicago, chicago, and chicago. [SEP] the midwest region, michigan, chicago, texas, [SEP] + +===== sample 062 ===== +[CLS] itself as the " mother of hope. " [SEP] the rally marked the end of a five - year trend as it turned to the mid - term. [SEP] on a, 14, 16, 16,, 15, 14 - - on a 10, 15, 15, 16,, 16,, 18, 24, at the end - - he seemed to make a point of himself. [SEP] that is a mark of weakness. [SEP] the pillars of the building ' s roof were blown up. [SEP] after the diagnosis, i came back to the hospital to see that i would have a doctor on the way to the hospital. [SEP] [SEP] + +===== sample 063 ===== +[CLS] $ 150 a ton, about 20 percent of the original cost. [SEP] i would provide an answer to your right question. [SEP] it might well be okay to eat, but not want to go to sleep in front of the sofa. [SEP] in 1919, on the fourth day of december, he died in the palace hotel in london. [SEP] he was returned to the courtroom and in the process had to make the case back again. [SEP] weeks,, weeks,, weeks, or months. [SEP] 21, 2007, when south dakota state police chief jim brown said he made a decision to buy the plane. [SEP] " it ' s a [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/state_c1024_t1p45_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/state_c1024_t1p45_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..79fcce0b9f68a3ca0a5beabfceb343691deb1852 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/state_c1024_t1p45_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "state_c1024_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c1024_t1p45", "steps": 32, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 31.13635173493272, "nll_per_token": 3.438376002668099, "tokens": 9165}, "diversity": {"sample_entropy": 3.3146319833825286, "unique_tokens": 1102, "token_count": 8192, "distinct_1": 0.134521484375, "distinct_2": 0.4309793307086614, "top_token_mass": 0.2288818359375}} +{"type": "sample", "index": 0, "raw_text": "[CLS] at the end of a deal. [SEP] science has found that it is true and makes no sense........ to back - to - back, 50, 50 to - 50, 50, 37, 48, 45, 45, and 52. [SEP] \" there was no time, on the same day, at the same time, no days, even days, just seven days, i do, \" he said. [SEP] he did not even let me dwell on the challenges of that... [SEP] we ' ll vote for obama.... [SEP] the meeting, called for monday afternoon, is to [SEP]", "detok_text": "[CLS] at the end of a deal. [SEP] science has found that it is true and makes no sense........ to back - to - back, 50, 50 to - 50, 50, 37, 48, 45, 45, and 52. [SEP] \"there was no time, on the same day, at the same time, no days, even days, just seven days, i do,\" he said. [SEP] he did not even let me dwell on the challenges of that... [SEP] we'll vote for obama.... [SEP] the meeting, called for monday afternoon, is to [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] 25, 40, 50, 50, 50, 60, 60, and the same period, when the hawks ' worst record was 14 - 14. [SEP] asheville, n. d., studied at the university of ohio, ohio, illinois university, ohio, texas, illinois, canada, ireland, the university of carolina and canada. [SEP] \" i think he has an option, \" romo said. [SEP] if the person is really prepared to do the job, this is a new beginning. [SEP] the group raised $ 16. 7 million in obama ' s first three days of campaign. [SEP] he ended a two - game [SEP]", "detok_text": "[CLS] 25, 40, 50, 50, 50, 60, 60, and the same period, when the hawks' worst record was 14 - 14. [SEP] asheville, n. d., studied at the university of ohio, ohio, illinois university, ohio, texas, illinois, canada, ireland, the university of carolina and canada. [SEP] \"i think he has an option,\" romo said. [SEP] if the person is really prepared to do the job, this is a new beginning. [SEP] the group raised $16. 7 million in obama's first three days of campaign. [SEP] he ended a two - game [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] - - - flights of 2, 07,, 07, and in for at least five hours - -,,,,,, 45,,, 52. [SEP] at the end of the day, he said, the pilot still managed to retrieve the severed parts of the plane. [SEP] in other cases, the combination of warmth and warmth. [SEP] the political leader has raised his official concern about the war in the time of the election as being \" ridiculous. \" [SEP] now, they would like to have a child with a doctor to get just a bit in the right room. [SEP] he then emerged from the balcony of the building [SEP]", "detok_text": "[CLS] - - - flights of 2, 07,, 07, and in for at least five hours - -,,,,,, 45,,, 52. [SEP] at the end of the day, he said, the pilot still managed to retrieve the severed parts of the plane. [SEP] in other cases, the combination of warmth and warmth. [SEP] the political leader has raised his official concern about the war in the time of the election as being \"ridiculous.\" [SEP] now, they would like to have a child with a doctor to get just a bit in the right room. [SEP] he then emerged from the balcony of the building [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS] of the period, period prior to making a decision, a period, period, period,,,,, period, period, period,,,,, day, period, day, period,, period,,,,,,, period, period. [SEP] and so, the period,, period, period, period,,,,,, period,,,,,,,,, period,,, period, period, period,, period, period, period,,,,,,, and period, the day is days, days, period, period, period, period,,,, [SEP]", "detok_text": "[CLS] of the period, period prior to making a decision, a period, period, period,,,,, period, period, period,,,,, day, period, day, period,, period,,,,,,, period, period. [SEP] and so, the period,, period, period, period,,,,,, period,,,,,,,,, period,,, period, period, period,, period, period, period,,,,,,, and period, the day is days, days, period, period, period, period,,,, [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] century - old building. [SEP] \" we have a lot of back - game games but, i remember, we have not had a game since 2003, \" he said. [SEP] instead, after 1914 and 1868, the convention to collapse in power led to the collapse of british communism. [SEP] \" the peak - to -, peak - to - - to - trough period... the days of december 1988, beginning in 1988, to - back - to - back period, and 1988, and december 2007, and,,,,, 1996, 1997,,,,, and, 2003, \" he said. [SEP] he [SEP]", "detok_text": "[CLS] century - old building. [SEP] \"we have a lot of back - game games but, i remember, we have not had a game since 2003,\" he said. [SEP] instead, after 1914 and 1868, the convention to collapse in power led to the collapse of british communism. [SEP] \"the peak - to -, peak - to - - to - trough period... the days of december 1988, beginning in 1988, to - back - to - back period, and 1988, and december 2007, and,,,,, 1996, 1997,,,,, and, 2003,\" he said. [SEP] he [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] december 16, 2008 in chicago. [SEP] kiwis is out for two months, days, weeks,, in the week to week, - -, week, week, week, week,, and week. [SEP] the bears are to face a series in chicago on - 16, dec. [SEP] he is going to be out of town for an interview. [SEP] boston, detroit 11 - 16, 11 - 11,, 11, and 11 - - to complete season - to - season winnings. [SEP] in his first year at the school, he died. [SEP] a group of protesters in the capital opened the door for its [SEP]", "detok_text": "[CLS] december 16, 2008 in chicago. [SEP] kiwis is out for two months, days, weeks,, in the week to week, - -, week, week, week, week,, and week. [SEP] the bears are to face a series in chicago on - 16, dec. [SEP] he is going to be out of town for an interview. [SEP] boston, detroit 11 - 16, 11 - 11,, 11, and 11 - - to complete season - to - season winnings. [SEP] in his first year at the school, he died. [SEP] a group of protesters in the capital opened the door for its [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] 21. 50. [SEP] obama says, days, days, days, in the morning, in the morning, and time to date these days, week, day, week,,, period. [SEP] the three - break began over a 15 - day period, a week of the end of the day and the rest of the night ' s day in the afternoon. [SEP] from three days, in the first quarter, to the next, 4, 4, 6, 8, 8, 11, and and, to the end of 2008. [SEP] the atlantis v, a space plane, is scheduled to take off at 7 : 15 [SEP]", "detok_text": "[CLS] 21. 50. [SEP] obama says, days, days, days, in the morning, in the morning, and time to date these days, week, day, week,,, period. [SEP] the three - break began over a 15 - day period, a week of the end of the day and the rest of the night's day in the afternoon. [SEP] from three days, in the first quarter, to the next, 4, 4, 6, 8, 8, 11, and and, to the end of 2008. [SEP] the atlantis v, a space plane, is scheduled to take off at 7: 15 [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] said. [SEP] \" we could say, it ' s the time to talk of bankruptcy, \" said said robert woodley, the president of the national automobile trade association of america, which organizes the union. [SEP] in the u. s., flights begin to 3, 000, 000 feet at the start of the day and increase to more than 30 -, -, -, -, -, -, -, -, 1, 000 - -. [SEP] notes : @ 4 - 4, detroit 0, calgary 0 - 6 - 2 - 2... [SEP] on december 14, 25, 2006, of the 91 [SEP]", "detok_text": "[CLS] said. [SEP] \"we could say, it's the time to talk of bankruptcy,\" said said robert woodley, the president of the national automobile trade association of america, which organizes the union. [SEP] in the u. s., flights begin to 3, 000, 000 feet at the start of the day and increase to more than 30 -, -, -, -, -, -, -, -, 1, 000 - -. [SEP] notes: @ 4 - 4, detroit 0, calgary 0 - 6 - 2 - 2... [SEP] on december 14, 25, 2006, of the 91 [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] 13 - year - old. [SEP] face - by - face, after all, at the end of her life, she was given time to time, time to time, time to time to time again. [SEP] now, the economy is in - - and in the future. [SEP] the two season series of games in cleveland, which is on june of - 14 in boston, the road series in atlanta and the game of the best - of - five series in san francisco. [SEP] finally, the bill of purchase was passed to the cpcb and the queen ' s for the period of which amounts to 100 days, respectively. [SEP] [SEP]", "detok_text": "[CLS] 13 - year - old. [SEP] face - by - face, after all, at the end of her life, she was given time to time, time to time, time to time to time again. [SEP] now, the economy is in - - and in the future. [SEP] the two season series of games in cleveland, which is on june of - 14 in boston, the road series in atlanta and the game of the best - of - five series in san francisco. [SEP] finally, the bill of purchase was passed to the cpcb and the queen's for the period of which amounts to 100 days, respectively. [SEP] [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and, in the first half of the year. [SEP] 13,, 14, 15, 15, 15, 30, and 4, 52... [SEP] of course, the team is completely out of place,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, of the year,,,,,,,,,,,,,, and,. [SEP] he [SEP]", "detok_text": "[CLS],,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and, in the first half of the year. [SEP] 13,, 14, 15, 15, 15, 30, and 4, 52... [SEP] of course, the team is completely out of place,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, of the year,,,,,,,,,,,,,, and,. [SEP] he [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS]9. 50 per person, including for a day - to - school stay. [SEP] it is expected to be 65,,,,,,,, 45, 51, 48,, 48, 48, 37, 48, 48. [SEP] the company ' s firm ' s list of operations in the trade is expected to include : 50,, 50, 60, 60, 50,, 50, 50,,,, 36,,,,,,,,,,,,,,,,,,, etc. [SEP] if the jets were to show in depth, the teams would be ready to move, [SEP]", "detok_text": "[CLS]9. 50 per person, including for a day - to - school stay. [SEP] it is expected to be 65,,,,,,,, 45, 51, 48,, 48, 48, 37, 48, 48. [SEP] the company's firm's list of operations in the trade is expected to include: 50,, 50, 60, 60, 50,, 50, 50,,,, 36,,,,,,,,,,,,,,,,,,, etc. [SEP] if the jets were to show in depth, the teams would be ready to move, [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] said he was given the opportunity to play in the olympics so far. [SEP] 51, 48 and it ' s day,,,,, day - - there ' ll be people to move,,,,,,,,,,,,,,, 48,, 48, 36,, 27,, 48,,,,,,,,,,, 48,,,, 48, the rest. [SEP] from the field,,,,,,, 49, 48, 49, 52, 54, seems to make the most of the woes,,,,,,,,,, [SEP]", "detok_text": "[CLS] said he was given the opportunity to play in the olympics so far. [SEP] 51, 48 and it's day,,,,, day - - there'll be people to move,,,,,,,,,,,,,,, 48,, 48, 36,, 27,, 48,,,,,,,,,,, 48,,,, 48, the rest. [SEP] from the field,,,,,,, 49, 48, 49, 52, 54, seems to make the most of the woes,,,,,,,,,, [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS] you can see that the author has a bit of scented cake, the scented fruit has an awful scented curse on the table. [SEP] in fact, the results will come soon, not even later. [SEP] the meeting was in fact a year away. [SEP] and then, more than 1, 200 passengers, including passengers, had to return to the airport monday morning to begin the 12 - hour stopover. [SEP] we have to talk come, come, break, we have to talk. [SEP] once they do, they will be able to feel, and when they do not feel back, they will feel more of a shock. [SEP] the [SEP]", "detok_text": "[CLS] you can see that the author has a bit of scented cake, the scented fruit has an awful scented curse on the table. [SEP] in fact, the results will come soon, not even later. [SEP] the meeting was in fact a year away. [SEP] and then, more than 1, 200 passengers, including passengers, had to return to the airport monday morning to begin the 12 - hour stopover. [SEP] we have to talk come, come, break, we have to talk. [SEP] once they do, they will be able to feel, and when they do not feel back, they will feel more of a shock. [SEP] the [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS] the rest of the 2004 - 7, including the back - to - back trip to the playoffs. [SEP] detroit 7, minnesota 27, 26, chicago,, cleveland,, chicago,, 50 - 48. - for the week, dec. - 60, 50 - 73, 50 - 73, 50 - 50, and beyond. - - 50 - 50, 37, 50, 50, 50, 50, parts of 50 - 49, 50 - 45, 60 - 50, in new york, boston 37, 50, boston 48, 50 - 50, 52, 60 - 60 and 48. - -,,, [SEP]", "detok_text": "[CLS] the rest of the 2004 - 7, including the back - to - back trip to the playoffs. [SEP] detroit 7, minnesota 27, 26, chicago,, cleveland,, chicago,, 50 - 48. - for the week, dec. - 60, 50 - 73, 50 - 73, 50 - 50, and beyond. - - 50 - 50, 37, 50, 50, 50, 50, parts of 50 - 49, 50 - 45, 60 - 50, in new york, boston 37, 50, boston 48, 50 - 50, 52, 60 - 60 and 48. - -,,, [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] we have to do it all together. [SEP] the man,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, to grow - up to his, and, oh, he opened his eyes at the end of the journey, and \" no one wants to be sure what he wants to be, \" he said. [SEP] however, the current period was about a year earlier and is much longer. [SEP] the guy who will, he said, make the tens of thousands of dollars. [SEP] \" i think they have to do it again. [SEP] [SEP]", "detok_text": "[CLS] we have to do it all together. [SEP] the man,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, to grow - up to his, and, oh, he opened his eyes at the end of the journey, and \"no one wants to be sure what he wants to be,\" he said. [SEP] however, the current period was about a year earlier and is much longer. [SEP] the guy who will, he said, make the tens of thousands of dollars. [SEP] \" i think they have to do it again. [SEP] [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS] good friend, not a woman,, sits in the back of the house, but has not been wearing an eye. [SEP] chicago, september 11, 2008, and chicago, dec. [SEP] of course, 50,, 50, 60, by the end of........ 60, 50, 50, and in the end, they want to be. [SEP] with more than a week left after tuesday ' s quake, trucks and dump piled with hundreds of cars and collapsed on the roofs of government buildings. [SEP] \" i was the first person to give me something to play during the day, \" he said [SEP]", "detok_text": "[CLS] good friend, not a woman,, sits in the back of the house, but has not been wearing an eye. [SEP] chicago, september 11, 2008, and chicago, dec. [SEP] of course, 50,, 50, 60, by the end of........ 60, 50, 50, and in the end, they want to be. [SEP] with more than a week left after tuesday's quake, trucks and dump piled with hundreds of cars and collapsed on the roofs of government buildings. [SEP] \"i was the first person to give me something to play during the day,\" he said [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS]. [SEP] with the examples above, it would be time to have a good day in 2009. [SEP] the flight crew, miraculously, took the way to the airport and then returned to the prison area for their rescue. [SEP] a few years after being introduced to saba, he is on the field, and he will be a highlight of the day. [SEP] the european transport committee has already provided such help. [SEP] rondo, who has 22, 13 assists and eight assists this season, scored seven straight points. [SEP] 11, not again, but for the first time in 13 days. [SEP] today, december 21, 2007, [SEP]", "detok_text": "[CLS]. [SEP] with the examples above, it would be time to have a good day in 2009. [SEP] the flight crew, miraculously, took the way to the airport and then returned to the prison area for their rescue. [SEP] a few years after being introduced to saba, he is on the field, and he will be a highlight of the day. [SEP] the european transport committee has already provided such help. [SEP] rondo, who has 22, 13 assists and eight assists this season, scored seven straight points. [SEP] 11, not again, but for the first time in 13 days. [SEP] today, december 21, 2007, [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS], the met ' s co - artistic director. [SEP] her goal was to have that the rest of her life, writing letters to read, arranging, and, sometimes, to write poems. [SEP] the period : 2 - 2 _ detroit 18, chicago 7, detroit - - bay, chicago, detroit 20 ( 4. 36 pp ). [SEP] according to the survey, back to 2003, it came to nothing. [SEP] for some reason, the colts lost the series to detroit, too. [SEP] \" i feel sorry, and he seems to have to look for that, \" she said. [SEP] a few years later, however, [SEP]", "detok_text": "[CLS], the met's co - artistic director. [SEP] her goal was to have that the rest of her life, writing letters to read, arranging, and, sometimes, to write poems. [SEP] the period: 2 - 2 _ detroit 18, chicago 7, detroit - - bay, chicago, detroit 20 (4. 36 pp). [SEP] according to the survey, back to 2003, it came to nothing. [SEP] for some reason, the colts lost the series to detroit, too. [SEP] \"i feel sorry, and he seems to have to look for that,\" she said. [SEP] a few years later, however, [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS] cent in december, the current reduction of 3. 8 to - 4. 9 per cent. [SEP] days of the past few days, days, days, days days to get in. days by the same week, days, week, week. [SEP] chicago - he ' s 50, 73, 73, 73, 73, 73, 73... [SEP] of course, after 50, 60, 65, they just are working days, days, weeks, and.. [SEP] vanilla, textured vanilla, chocolate - vanilla, sweet vanilla, sugared, vanilla, and salted, anded, at the start of the [SEP]", "detok_text": "[CLS] cent in december, the current reduction of 3. 8 to - 4. 9 per cent. [SEP] days of the past few days, days, days, days days to get in. days by the same week, days, week, week. [SEP] chicago - he's 50, 73, 73, 73, 73, 73, 73... [SEP] of course, after 50, 60, 65, they just are working days, days, weeks, and.. [SEP] vanilla, textured vanilla, chocolate - vanilla, sweet vanilla, sugared, vanilla, and salted, anded, at the start of the [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] - 15, 18, 15, 16, 16, 16,, 16, 18, and then,. 13, 1 - 18, 1 - 3, 14 - 15, 26, 26, 16, 18,,,, 16,,, 16, 16,, 13 - 16, 16 - 17, at about 0630 bst on december 7. [SEP] the magic led, 51 - 48, charlotte, chicago, ( 25 - 14, 16 - 16, 16 - 14 ). [SEP] i have to say you have a chance to breathe, tim. [SEP] the man, a wavy, hefty black [SEP]", "detok_text": "[CLS] - 15, 18, 15, 16, 16, 16,, 16, 18, and then,. 13, 1 - 18, 1 - 3, 14 - 15, 26, 26, 16, 18,,,, 16,,, 16, 16,, 13 - 16, 16 - 17, at about 0630 bst on december 7. [SEP] the magic led, 51 - 48, charlotte, chicago, (25 - 14, 16 - 16, 16 - 14). [SEP] i have to say you have a chance to breathe, tim. [SEP] the man, a wavy, hefty black [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] period - to - period for the day, period, period, period, period, time to start, period, - - to the end, period, period, day, day,, in the period,, with debrinks and day, period. [SEP] he said the planes were period, 50 -,,,,,,,,,,, 30 - and 50 - to weeks. [SEP] mr brown said that the meeting was full, normally, and that he had been assigned to the site to participate in training hours. [SEP] \" we ' ve cut back from week to week to week to, \" he [SEP]", "detok_text": "[CLS] period - to - period for the day, period, period, period, period, time to start, period, - - to the end, period, period, day, day,, in the period,, with debrinks and day, period. [SEP] he said the planes were period, 50 -,,,,,,,,,,, 30 - and 50 - to weeks. [SEP] mr brown said that the meeting was full, normally, and that he had been assigned to the site to participate in training hours. [SEP] \"we've cut back from week to week to week to,\" he [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] the first quarter, 1991 and 1996. [SEP] in the pre - trade agreement, the teams chicago, chicago, chicago, chicago, chicago, new york, chicago, chicago and detroit, which has chicago in chicago, called the city council, which specializes in the cities of chicago, chicago, chicago and chicago, a \" chicago alliance. \" [SEP] the children are not expected to appear for about 15 minutes. [SEP] \" for now, we ' ve been told, the stock is not going to come down, \" mchaeag said. [SEP] we ' ll wait a little while to see the end come time after time again. [SEP] [SEP]", "detok_text": "[CLS] the first quarter, 1991 and 1996. [SEP] in the pre - trade agreement, the teams chicago, chicago, chicago, chicago, chicago, new york, chicago, chicago and detroit, which has chicago in chicago, called the city council, which specializes in the cities of chicago, chicago, chicago and chicago, a \"chicago alliance.\" [SEP] the children are not expected to appear for about 15 minutes. [SEP] \"for now, we've been told, the stock is not going to come down,\" mchaeag said. [SEP] we'll wait a little while to see the end come time after time again. [SEP] [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS], gordon ( 54 ), blaney ( detroit, 54 ). [SEP] in a typical time period, at half - time, the period period, period, 50,, 40,, 50,, 50, 60, 50, and 52. [SEP] we are not a dog,, to have a dog,,,, to have a dog. [SEP] meanwhile, if we have built a universe of opportunity - - 50 years or less - - then the vision of social mobility will become even more profound - - just when you know days, days,, days, days, days,,,,,,,, [SEP]", "detok_text": "[CLS], gordon (54), blaney (detroit, 54). [SEP] in a typical time period, at half - time, the period period, period, 50,, 40,, 50,, 50, 60, 50, and 52. [SEP] we are not a dog,, to have a dog,,,, to have a dog. [SEP] meanwhile, if we have built a universe of opportunity - - 50 years or less - - then the vision of social mobility will become even more profound - - just when you know days, days,, days, days, days,,,,,,,, [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS] into different areas of the city, which ranges from 200 to 300, 000 feet for the entire area. [SEP] obama ' s father ' s list of priorities is a short list at the top : chicago, ga., chicago, chicago,, chicago ( r ),... [SEP] s gordon, t chicago, b quinn, b m - t, s james, s - t, s hamilton. [SEP] 6, n. y. at cleveland, 10 : 50 p. m. [SEP] the case of a 24 - year - old student, who said he has been charged, would be suspended in january for three weeks [SEP]", "detok_text": "[CLS] into different areas of the city, which ranges from 200 to 300, 000 feet for the entire area. [SEP] obama's father's list of priorities is a short list at the top: chicago, ga., chicago, chicago,, chicago (r),... [SEP] s gordon, t chicago, b quinn, b m - t, s james, s - t, s hamilton. [SEP] 6, n. y. at cleveland, 10: 50 p. m. [SEP] the case of a 24 - year - old student, who said he has been charged, would be suspended in january for three weeks [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] days in the morning, then days, days, days, days, days, days, days, days in the early days, and then, days in the early days. [SEP] i ' ve always thought, beginning to end, end to period to end,, to start,, more than end to start, to end to end, to end, to start to the road. [SEP] however, it seems that the planes have to go back to tomorrow, so the airlines would be making plans to hire more planes and return them in the afternoon and morning, the planes are not going to operate. [SEP] but, he said, [SEP]", "detok_text": "[CLS] days in the morning, then days, days, days, days, days, days, days, days in the early days, and then, days in the early days. [SEP] i've always thought, beginning to end, end to period to end,, to start,, more than end to start, to end to end, to end, to start to the road. [SEP] however, it seems that the planes have to go back to tomorrow, so the airlines would be making plans to hire more planes and return them in the afternoon and morning, the planes are not going to operate. [SEP] but, he said, [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] said. [SEP] the number was 50,, 50, and days. [SEP] on the basis of 50,,,,,,,,,,, 20 -,, and he, 10, 13, 7 - in. [SEP] i don ' t forget the numbers 50, 50, 50, and 50,,,, 50, 50, 50, 50, 49,, 37 / sch, 98, 73, 98, 98, 98, 98, 89 of the other 50. [SEP] in reality, the former president has an excuse to go on the offensive yet, before the rest of the world is able to [SEP]", "detok_text": "[CLS] said. [SEP] the number was 50,, 50, and days. [SEP] on the basis of 50,,,,,,,,,,, 20 -,, and he, 10, 13, 7 - in. [SEP] i don't forget the numbers 50, 50, 50, and 50,,,, 50, 50, 50, 50, 49,, 37/sch, 98, 73, 98, 98, 98, 98, 89 of the other 50. [SEP] in reality, the former president has an excuse to go on the offensive yet, before the rest of the world is able to [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] in december. [SEP] i don ' t know what that was going on. [SEP] much of the roughly 33, 000 - mile - a - mile route is just over 3. 3 miles. [SEP] i ' m staggered by the iranian government. [SEP] in the case of the program, the canadian astronaut, who in turn, was scheduled to begin working at the station on jan. [SEP] it ' s just the beginning of the healing process, \" he said. [SEP] the celtics lost to chicago for the first time at home since the equivalent of a 1996 games in the olympic finals of chicago - - the first conference series game since the chicago [SEP]", "detok_text": "[CLS] in december. [SEP] i don't know what that was going on. [SEP] much of the roughly 33, 000 - mile - a - mile route is just over 3. 3 miles. [SEP] i'm staggered by the iranian government. [SEP] in the case of the program, the canadian astronaut, who in turn, was scheduled to begin working at the station on jan. [SEP] it's just the beginning of the healing process, \" he said. [SEP] the celtics lost to chicago for the first time at home since the equivalent of a 1996 games in the olympic finals of chicago - - the first conference series game since the chicago [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS] 89, 89,, 89, chicago ' s, 93, 95, 89, 89, 89, 89, 89,, 89, 89,, 89, 89, 89, 89,, 89, 90,, 89, 89, 89, etc. [SEP] in the meantime,,,,,,,,,,,,, and then, he ' s back again. [SEP] he wanted to talk and then told him to get back in there, \" he said. [SEP] \" we will know it ' s going to be, \" he said. \" [SEP] instead, he ' s done in six days. [SEP]", "detok_text": "[CLS] 89, 89,, 89, chicago's, 93, 95, 89, 89, 89, 89, 89,, 89, 89,, 89, 89, 89, 89,, 89, 90,, 89, 89, 89, etc. [SEP] in the meantime,,,,,,,,,,,,, and then, he's back again. [SEP] he wanted to talk and then told him to get back in there, \"he said. [SEP]\" we will know it's going to be, \"he said.\" [SEP] instead, he's done in six days. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS], he has to turn up 50, 50,, 50, 60, 50, 50,, 50, 52 and day - to - day, day,, night,, and, day in a couple of days. \" [SEP] the plane, which has been synonymous with history since the decades, came at the end of 2003, the last time the aircraft ' s planes crashed, but officials say the problem caused the air plane to stop at least a weeks later. [SEP] \" if i read something, i don ' t think it will work, make a good point. [SEP] then,, and then,,, maybe, [SEP]", "detok_text": "[CLS], he has to turn up 50, 50,, 50, 60, 50, 50,, 50, 52 and day - to - day, day,, night,, and, day in a couple of days. \"[SEP] the plane, which has been synonymous with history since the decades, came at the end of 2003, the last time the aircraft's planes crashed, but officials say the problem caused the air plane to stop at least a weeks later. [SEP]\" if i read something, i don't think it will work, make a good point. [SEP] then,, and then,,, maybe, [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] to do with the game, but we do have to move from time to time. [SEP] in the end, most of the workers from michigan, michigan, michigan, texas, michigan and new jersey. [SEP] it was a shame, a good thing, a chance to be very good. [SEP] in the first week of the day, the celtics and the celtics, had the back - to - back - to games of the season. [SEP] it ' s a little late for end - of - the - road travellers, to return to quick, off - the - road access to the streets of london. [SEP] chicago, ohio ( ap [SEP]", "detok_text": "[CLS] to do with the game, but we do have to move from time to time. [SEP] in the end, most of the workers from michigan, michigan, michigan, texas, michigan and new jersey. [SEP] it was a shame, a good thing, a chance to be very good. [SEP] in the first week of the day, the celtics and the celtics, had the back - to - back - to games of the season. [SEP] it's a little late for end - of - the - road travellers, to return to quick, off - the - road access to the streets of london. [SEP] chicago, ohio ( ap [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] to the market. [SEP] to, to understand, to take back. [SEP] i do not know how much of a point of the road is to a little bump in the road, \" he said, who asked to name the reason for that. [SEP] there is a need to dunk in the towel. [SEP] yes, there ' s a sense of desperation. [SEP] 1, october 22, october 16, 2006, october 14, dec. [SEP] i have to get up and walk on the road. [SEP] to finish,,, to finish... he is going to run,, to get down to make a turn, [SEP]", "detok_text": "[CLS] to the market. [SEP] to, to understand, to take back. [SEP] i do not know how much of a point of the road is to a little bump in the road, \" he said, who asked to name the reason for that. [SEP] there is a need to dunk in the towel. [SEP] yes, there's a sense of desperation. [SEP] 1, october 22, october 16, 2006, october 14, dec. [SEP] i have to get up and walk on the road. [SEP] to finish,,, to finish... he is going to run,, to get down to make a turn, [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] in 2003. [SEP] \" oh, chicago,, chicago - -,, chicago, chicago and, oh, you, chicago, \" said jordan and his brother, jordan, referring to the black - and - white team. [SEP] the planes - - small, small and small - - were delayed for several hours, he said. [SEP] its guest performers include willie golds, willie lewis and others ( morris, willie jackson, wilson, james brown ) during the past 50 years. [SEP] i would prefer the bread, however, it ' s fresh, so start the process, and put it on the boil, give it back. [SEP]", "detok_text": "[CLS] in 2003. [SEP] \"oh, chicago,, chicago - -,, chicago, chicago and, oh, you, chicago,\" said jordan and his brother, jordan, referring to the black - and - white team. [SEP] the planes - - small, small and small - - were delayed for several hours, he said. [SEP] its guest performers include willie golds, willie lewis and others (morris, willie jackson, wilson, james brown) during the past 50 years. [SEP] i would prefer the bread, however, it's fresh, so start the process, and put it on the boil, give it back. [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS], then, be the neo - liberal, turn the line, say, \" oh, oh, oh, \" she ' s okay, even if nothing, in the bill, they not cover the bill. [SEP] so, to remember to say, \" to use the word, \" - - \" use the word,, \" \" prefix, \" \" or whatever. \" [SEP] no matter, he said, it is so obvious that the burmese majority leader is still fighting a \" dirty war. \" [SEP] it is a b,,,, y,, a,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS], then, be the neo - liberal, turn the line, say, \"oh, oh, oh,\" she's okay, even if nothing, in the bill, they not cover the bill. [SEP] so, to remember to say, \"to use the word,\" - - \"use the word,,\" \"prefix,\" \"or whatever.\" [SEP] no matter, he said, it is so obvious that the burmese majority leader is still fighting a \"dirty war.\" [SEP] it is a b,,,, y,, a,,,,,,,,,,,,, [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], 14 - 14, well ahead of the no. 9 - point mark. [SEP] but it is a joke. [SEP] that, the answer is, you know. [SEP] come on to go with a good friend and get back to work again. [SEP] \" he is in a place to do things, this is just the way to make a relationship, the things to love, the things to want to do for all of us. [SEP] deutsche bahn has also said it wants to work better with the trade union and its transport workers. [SEP] detroit ( ap ) - as a top - seeded team in the national conference, the detroit tigers [SEP]", "detok_text": "[CLS], 14 - 14, well ahead of the no. 9 - point mark. [SEP] but it is a joke. [SEP] that, the answer is, you know. [SEP] come on to go with a good friend and get back to work again. [SEP] \" he is in a place to do things, this is just the way to make a relationship, the things to love, the things to want to do for all of us. [SEP] deutsche bahn has also said it wants to work better with the trade union and its transport workers. [SEP] detroit (ap) - as a top - seeded team in the national conference, the detroit tigers [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] the al - flyers, who joined the franchise in december 2008. [SEP] it is not day, time of period, period, time of season, time of change. [SEP] detroit, chicago, chicago,, chicago,, chicago, chicago, miami, chicago, indiana, chicago, chicago, new jersey, chicago, chicago, chicago, chicago,, chicago, chicago, us, chicago, chicago, chicago, chicago, ohio,, michigan,... [SEP] just add detroit, chicago, chicago, detroit, chicago, chicago. [SEP] but, however, if the new administration has time to reach a goal, it will be [SEP]", "detok_text": "[CLS] the al - flyers, who joined the franchise in december 2008. [SEP] it is not day, time of period, period, time of season, time of change. [SEP] detroit, chicago, chicago,, chicago,, chicago, chicago, miami, chicago, indiana, chicago, chicago, new jersey, chicago, chicago, chicago, chicago,, chicago, chicago, us, chicago, chicago, chicago, chicago, ohio,, michigan,... [SEP] just add detroit, chicago, chicago, detroit, chicago, chicago. [SEP] but, however, if the new administration has time to reach a goal, it will be [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS] to secure a series of back - to - back meetings with the yankees. [SEP] time,,,,,, change, period, re - start to get to work, and, eventually, to be done at the end of the year for other manufacturers. [SEP] for information, please contact the amex, u. s. department of the sec. [SEP] also, he is the conductor, who has to work from beginning to the end. [SEP] of the victims, only two were women. [SEP] chicago, in chicago, chicago, detroit, chicago, chicago, chicago, and chicago, the only city in order to receive the [SEP]", "detok_text": "[CLS] to secure a series of back - to - back meetings with the yankees. [SEP] time,,,,,, change, period, re - start to get to work, and, eventually, to be done at the end of the year for other manufacturers. [SEP] for information, please contact the amex, u. s. department of the sec. [SEP] also, he is the conductor, who has to work from beginning to the end. [SEP] of the victims, only two were women. [SEP] chicago, in chicago, chicago, detroit, chicago, chicago, chicago, and chicago, the only city in order to receive the [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS], s. 73 73, 75, 73, 100, 73 73, 71 73, 73, 73, 73, 73, 73, 73, 73, 73, 73, 73 and 73, 73, 70,, 73, etc. we are 65, 70 70, 73,, 73, 73,, and so. total of 60, 73, 73, 73, 73, 73, 73, 73, 73, 73, 70 54, 73, 54, 70 54, 73, 73, 73, 70 68, 73, 73, 73, 54., 51, 54, 54, 52, 73 [SEP]", "detok_text": "[CLS], s. 73 73, 75, 73, 100, 73 73, 71 73, 73, 73, 73, 73, 73, 73, 73, 73, 73, 73 and 73, 73, 70,, 73, etc. we are 65, 70 70, 73,, 73, 73,, and so. total of 60, 73, 73, 73, 73, 73, 73, 73, 73, 73, 70 54, 73, 54, 70 54, 73, 73, 73, 70 68, 73, 73, 73, 54., 51, 54, 54, 52, 73 [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] 37, 51, 542, 49, 49, 49, 48, 49, 49, 54, 54, 73, 73, 73, 73, 73, 73,, 159, 159, 159, 159, 159, 522, 528, 255, 365, 638, 737, 49, 49, 68, 49, 73, 73, 73, 73, 50, 73, 54, 76, 37, 37, 37, 45, 49. [SEP] the chrysler group, which belongs to an industrial association comprised of detroit, chicago, ohio,, chicago, and chicago and participates in the traditional alliance [SEP]", "detok_text": "[CLS] 37, 51, 542, 49, 49, 49, 48, 49, 49, 54, 54, 73, 73, 73, 73, 73, 73,, 159, 159, 159, 159, 159, 522, 528, 255, 365, 638, 737, 49, 49, 68, 49, 73, 73, 73, 73, 50, 73, 54, 76, 37, 37, 37, 45, 49. [SEP] the chrysler group, which belongs to an industrial association comprised of detroit, chicago, ohio,, chicago, and chicago and participates in the traditional alliance [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] thousands of dollars in 2002. [SEP] but the nets have had only three - - in 2002, 2004 and 2006, just before the playoffs. [SEP] the place of the wine is the destination, rather than the taste. [SEP] with the speed, the speed, the time lapse, the vertical area - - the gray area, and the vertical length of the 20 - year, period, the depth of the plane, the 15 -,, 12 -, -,,, 16 -,, 16 -,, and, and the combination of 15, 24, 30,,,,, 16 -,, 16 -, [SEP]", "detok_text": "[CLS] thousands of dollars in 2002. [SEP] but the nets have had only three - - in 2002, 2004 and 2006, just before the playoffs. [SEP] the place of the wine is the destination, rather than the taste. [SEP] with the speed, the speed, the time lapse, the vertical area - - the gray area, and the vertical length of the 20 - year, period, the depth of the plane, the 15 -,, 12 -, -,,, 16 -,, 16 -,, and, and the combination of 15, 24, 30,,,,, 16 -,, 16 -, [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] games. [SEP] people seem to have forgotten that today, on the days of the day or not, the day is well after the day. [SEP] the amount of investment has to be ramped up to the point. [SEP] at the other end, mccain is trying to break the point. [SEP] had the team reached the end of the playoffs of 2002, it would have made the playoffs of 2007, the year, 2006, and, of the post - season, the year of the 2004 championship. [SEP] add to the fat - butter, add salt, salt and water to reach the other end of it. [SEP] the firm has already [SEP]", "detok_text": "[CLS] games. [SEP] people seem to have forgotten that today, on the days of the day or not, the day is well after the day. [SEP] the amount of investment has to be ramped up to the point. [SEP] at the other end, mccain is trying to break the point. [SEP] had the team reached the end of the playoffs of 2002, it would have made the playoffs of 2007, the year, 2006, and, of the post - season, the year of the 2004 championship. [SEP] add to the fat - butter, add salt, salt and water to reach the other end of it. [SEP] the firm has already [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] they have to get out of the door. \" [SEP] the planes, then, the need to day, day, day, and day - care approach to the ground. [SEP] it is also time for monday, november, december and october. [SEP] \" we are just 0. 5 % at the moment. [SEP] in contrast, thomson, based in strasbourg, france, was closed for a week. [SEP] the 1996, 2004, are for the period, 2004,, 2003, 1997, 2003, 1997, 1996, 1997, 1981, 2004, and 2004, 2004, and the previous 2004, 2004,, and 2007 in the [SEP]", "detok_text": "[CLS] they have to get out of the door. \"[SEP] the planes, then, the need to day, day, day, and day - care approach to the ground. [SEP] it is also time for monday, november, december and october. [SEP]\" we are just 0. 5 % at the moment. [SEP] in contrast, thomson, based in strasbourg, france, was closed for a week. [SEP] the 1996, 2004, are for the period, 2004,, 2003, 1997, 2003, 1997, 1996, 1997, 1981, 2004, and 2004, 2004, and the previous 2004, 2004,, and 2007 in the [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] - this time, to take the final step of their series to get to the postseason finals and reach the next playoffs. [SEP] in the first week of the year, 10, 15, 15, 14, 26, 26, 26, and in the last quarter, and,,,,,,,,, the whole pattern has been completed. [SEP] but in the end, i was,,,,, again,,,,,,,,,,,,,,,,,,, we will be seeing that again. [SEP] it is just pity, but for nothing. [SEP] lahka ' s [SEP]", "detok_text": "[CLS] - this time, to take the final step of their series to get to the postseason finals and reach the next playoffs. [SEP] in the first week of the year, 10, 15, 15, 14, 26, 26, 26, and in the last quarter, and,,,,,,,,, the whole pattern has been completed. [SEP] but in the end, i was,,,,, again,,,,,,,,,,,,,,,,,,, we will be seeing that again. [SEP] it is just pity, but for nothing. [SEP] lahka's [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] 50, 50, 15, 16, 18, 18, 14 - - and the numbers 50, 50, 49, 60, 17, 16, 36,, and so. [SEP] patrick croyle, 15, 21,, 21, 21, 37, 51, 37, 52, 37, 49,, 37,, 37,,,, 51,, 48, 37, 48,, 45,,,, 48, and 58. [SEP] in the uk,,, 48,,,, 52,, 54. [SEP] the week of the year, the sixth week of december, was the fourth - [SEP]", "detok_text": "[CLS] 50, 50, 15, 16, 18, 18, 14 - - and the numbers 50, 50, 49, 60, 17, 16, 36,, and so. [SEP] patrick croyle, 15, 21,, 21, 21, 37, 51, 37, 52, 37, 49,, 37,, 37,,,, 51,, 48, 37, 48,, 45,,,, 48, and 58. [SEP] in the uk,,, 48,,,, 52,, 54. [SEP] the week of the year, the sixth week of december, was the fourth - [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS], 000, in the second quarter of 2008, and 40, 000 for the second quarter.... [SEP] 1, 2007, the year of december 2007, the two companies, in central michigan, illinois, chicago, michigan, massachusetts, to compete with the likes of michigan, michigan, michigan, chicago, ohio, michigan, michigan, illinois,, michigan, massachusetts, of course, and michigan, michigan and michigan, michigan. [SEP] the ism ' s new orders fell from 1997 to 98, the lowest monthly total since the start of the year, with the lowest total in 2006 - 07. [SEP] at least the [SEP]", "detok_text": "[CLS], 000, in the second quarter of 2008, and 40, 000 for the second quarter.... [SEP] 1, 2007, the year of december 2007, the two companies, in central michigan, illinois, chicago, michigan, massachusetts, to compete with the likes of michigan, michigan, michigan, chicago, ohio, michigan, michigan, illinois,, michigan, massachusetts, of course, and michigan, michigan and michigan, michigan. [SEP] the ism's new orders fell from 1997 to 98, the lowest monthly total since the start of the year, with the lowest total in 2006 - 07. [SEP] at least the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS]..... [SEP] in michigan, michigan, michigan, florida, michigan,,,, michigan, michigan, michigan,, michigan, ohio, michigan, 50,,, 50, 60,,,,,,, 50, 50,, 50, 70, 2, 1, 1, 2,, 4. [SEP] the numbers 14, 17, 26,,,, 11, 11, 13, 17, 15, 15, 11, 11, 14, 16, 15, 13, 14, 14. [SEP] the knicks, bulls, a lot of the fans, and the media, all all have [SEP]", "detok_text": "[CLS]..... [SEP] in michigan, michigan, michigan, florida, michigan,,,, michigan, michigan, michigan,, michigan, ohio, michigan, 50,,, 50, 60,,,,,,, 50, 50,, 50, 70, 2, 1, 1, 2,, 4. [SEP] the numbers 14, 17, 26,,,, 11, 11, 13, 17, 15, 15, 11, 11, 14, 16, 15, 13, 14, 14. [SEP] the knicks, bulls, a lot of the fans, and the media, all all have [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS]. [SEP] cover the potatoes in minutes,, and then, and,, but then, again, later in the day, and in the end. [SEP] it is time to the weather, the heat, the crowd, the presence of heat, lights, jets, jets, showers,, hopefully, the rest of the event. [SEP] 1, 2,,,,,, on the date,,,,,,,,, and, in a week with a range of 50, 000 to more. [SEP] the years 2000, 2003, 2004,, 2002, 2004, 2004, and 2004, respectively. here, [SEP]", "detok_text": "[CLS]. [SEP] cover the potatoes in minutes,, and then, and,, but then, again, later in the day, and in the end. [SEP] it is time to the weather, the heat, the crowd, the presence of heat, lights, jets, jets, showers,, hopefully, the rest of the event. [SEP] 1, 2,,,,,, on the date,,,,,,,,, and, in a week with a range of 50, 000 to more. [SEP] the years 2000, 2003, 2004,, 2002, 2004, 2004, and 2004, respectively. here, [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS], ohio, ohio, and cleveland, ohio. [SEP] 1997 - 98, chicago,, chicago, chicago, 1996, chicago, 1996 - 98, 1996, 1996,, 2000, 2004. the combination of, 89, 90, 1981, 1988 - 90,,,,,, 1985,,,,,, 89, and 98. [SEP] philadelphia ( 8 - 5 ) also got the second goal and four outs in a 2 - 2 victory, the longest - game - ever game. [SEP] in the midwest, chicago, michigan,, chicago, chicago, north carolina, chicago, chicago, chicago, st., [SEP]", "detok_text": "[CLS], ohio, ohio, and cleveland, ohio. [SEP] 1997 - 98, chicago,, chicago, chicago, 1996, chicago, 1996 - 98, 1996, 1996,, 2000, 2004. the combination of, 89, 90, 1981, 1988 - 90,,,,,, 1985,,,,,, 89, and 98. [SEP] philadelphia (8 - 5) also got the second goal and four outs in a 2 - 2 victory, the longest - game - ever game. [SEP] in the midwest, chicago, michigan,, chicago, chicago, north carolina, chicago, chicago, chicago, st., [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] he said. [SEP] you would like to have a face - to - face meeting with the same team - - chicago, chicago, post - season meeting in a couple of weeks, etc. [SEP] he led the delegation to the conference centre of the british embassy. [SEP] but, there ' s time to prepare the pasta and make a stew. [SEP] 2008 - 2008 $ 7. 7 percent ( 2. 0 ), - $ ( 13. 9 ) 8. 9 billion euros ( $ 17. 3 billion. [SEP] and all of that, in chicago, chicago, chicago, miami, miami, chicago, chicago, all of the [SEP]", "detok_text": "[CLS] he said. [SEP] you would like to have a face - to - face meeting with the same team - - chicago, chicago, post - season meeting in a couple of weeks, etc. [SEP] he led the delegation to the conference centre of the british embassy. [SEP] but, there's time to prepare the pasta and make a stew. [SEP] 2008 - 2008 $7. 7 percent (2. 0), - $(13. 9) 8. 9 billion euros ( $17. 3 billion. [SEP] and all of that, in chicago, chicago, chicago, miami, miami, chicago, chicago, all of the [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS] - - sometimes literally, sometimes in a trance, all in the same way that they tell us. [SEP] \" now we can look at the numbers, we ' re going to make a big change at the moment. [SEP] then, then,, then, then, then, and then, it is the right thing to deal with. [SEP] on sunday, the white bulls will travel to the city for a road trip. [SEP] he led the first three batters, but the yankees and boston did the same in the first quarter. [SEP] chicago, chicago, chicago, chicago,, calgary, and chicago, oct. [SEP] the company [SEP]", "detok_text": "[CLS] - - sometimes literally, sometimes in a trance, all in the same way that they tell us. [SEP] \" now we can look at the numbers, we're going to make a big change at the moment. [SEP] then, then,, then, then, then, and then, it is the right thing to deal with. [SEP] on sunday, the white bulls will travel to the city for a road trip. [SEP] he led the first three batters, but the yankees and boston did the same in the first quarter. [SEP] chicago, chicago, chicago, chicago,, calgary, and chicago, oct. [SEP] the company [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS]. [SEP] \" he seems to be clever, he gets away with it, he needs to be more flexible, much more flexible... more than a, well, more than a, less clever. [SEP] in a statement to the conference board, dr james sanderson, regional director for the g & g - g schools and health organisation, said that the increase in additional loan commitments had an average value of $ 2. 6 million, up from $ 4. 9 million, at the year ' s end. [SEP] you will need a full trip -,,,,,, - - that comes later, not later, [SEP]", "detok_text": "[CLS]. [SEP] \" he seems to be clever, he gets away with it, he needs to be more flexible, much more flexible... more than a, well, more than a, less clever. [SEP] in a statement to the conference board, dr james sanderson, regional director for the g & g - g schools and health organisation, said that the increase in additional loan commitments had an average value of $2. 6 million, up from $4. 9 million, at the year's end. [SEP] you will need a full trip -,,,,,, - - that comes later, not later, [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] would not seem to have it at the top. [SEP] the economy is back on the road, ok!..... you look, are we going to get it, leave it, end of the road?. [SEP] this time, day, day of the year, 50, 50, 52, 37, 52, and december. [SEP] the game is always in the middle and at the moment you have to be long enough to organize and take care of the right things. [SEP] on saturday, obama returned to kenya in a mood, a symbol of hope. [SEP] if they have managed to get back to a point of [SEP]", "detok_text": "[CLS] would not seem to have it at the top. [SEP] the economy is back on the road, ok!..... you look, are we going to get it, leave it, end of the road?. [SEP] this time, day, day of the year, 50, 50, 52, 37, 52, and december. [SEP] the game is always in the middle and at the moment you have to be long enough to organize and take care of the right things. [SEP] on saturday, obama returned to kenya in a mood, a symbol of hope. [SEP] if they have managed to get back to a point of [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS], 2003,, 1996, 1996, 1996, 2002, \" he said. [SEP] \" they have a two - week plan - - then they have a day and day and day and day and and then, and here, we have a team in the playoffs. [SEP] district attorney stephen patterson said he had no complaints about sampson. [SEP] single - family suvs are at the back - to - back games, chicago, chicago, chicago, chicago and other cities. [SEP] there he was in 1988, 1988, 1988, 1988, 1996, 1996, 1996, 1996, 1988, 1997, 2002 - - dispiriting the [SEP]", "detok_text": "[CLS], 2003,, 1996, 1996, 1996, 2002, \"he said. [SEP]\" they have a two - week plan - - then they have a day and day and day and day and and then, and here, we have a team in the playoffs. [SEP] district attorney stephen patterson said he had no complaints about sampson. [SEP] single - family suvs are at the back - to - back games, chicago, chicago, chicago, chicago and other cities. [SEP] there he was in 1988, 1988, 1988, 1988, 1996, 1996, 1996, 1996, 1988, 1997, 2002 - - dispiriting the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] the seasons 16, 14, 14, and 16. [SEP] the defendant, who ' s refused to grant such an order, told the court that two days earlier, he received about £100, 000. [SEP] i can ' t imagine that significant gains in housing - - and, small - value employment - - are in the deep recession. [SEP] december 14, 1893, u. s. troops, oct. [SEP] the nation ' s worst road game - - 14, 4, 000 - - was the worst game of the season. [SEP] for example, the firm said, 90 percent of single - and multi - family vehicles, which [SEP]", "detok_text": "[CLS] the seasons 16, 14, 14, and 16. [SEP] the defendant, who's refused to grant such an order, told the court that two days earlier, he received about £100, 000. [SEP] i can't imagine that significant gains in housing - - and, small - value employment - - are in the deep recession. [SEP] december 14, 1893, u. s. troops, oct. [SEP] the nation's worst road game - - 14, 4, 000 - - was the worst game of the season. [SEP] for example, the firm said, 90 percent of single - and multi - family vehicles, which [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] for free, flights, flights - - and, in all, for the holidays. [SEP] the 6 - 15, 16, 17, 15, 15,, 18, 25,, 26, came to the end and 50, 50, and quit. [SEP] at that, he would have a year to live and a year to live. [SEP] however, bread and butter does not seem to lose its sparkle in the morning, so it is a good time to turn the boil on. [SEP] he spent a week with the dolphins in the chicago area, then turned twice in games to the bengals. [SEP] the first protests were started in [SEP]", "detok_text": "[CLS] for free, flights, flights - - and, in all, for the holidays. [SEP] the 6 - 15, 16, 17, 15, 15,, 18, 25,, 26, came to the end and 50, 50, and quit. [SEP] at that, he would have a year to live and a year to live. [SEP] however, bread and butter does not seem to lose its sparkle in the morning, so it is a good time to turn the boil on. [SEP] he spent a week with the dolphins in the chicago area, then turned twice in games to the bengals. [SEP] the first protests were started in [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] come from outside the united states, spokesman robert kelly said. [SEP] for example, the original path, the top - the - road, and the roof appeared on the back end, along with the entire back seat. [SEP] \" the celtics took a face - to - face trip to a 14 - game series, back - to, back - and - forth. [SEP] in the second quarter, they beat the celtics, the chicago bulls, the chicago bears, so 0 - 1 that they went on to win - - either. [SEP] in atlanta, chicago, chicago, chicago, chicago, chicago, and again. [SEP] \" the secret [SEP]", "detok_text": "[CLS] come from outside the united states, spokesman robert kelly said. [SEP] for example, the original path, the top - the - road, and the roof appeared on the back end, along with the entire back seat. [SEP] \"the celtics took a face - to - face trip to a 14 - game series, back - to, back - and - forth. [SEP] in the second quarter, they beat the celtics, the chicago bulls, the chicago bears, so 0 - 1 that they went on to win - - either. [SEP] in atlanta, chicago, chicago, chicago, chicago, chicago, and again. [SEP]\" the secret [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]. [SEP] 2. 13 - 2, detroit 7 - 11, detroit 11 - 1 - 2, detroit, s. chicago, detroit 11 - 14 - 1. 26 ). [SEP] the dow jones industrial index dropped by 2. 8 percentage points. [SEP] 18, 2007, is the \" day of the year, \" she said. [SEP] the teams chicago, boston, chicago, boston,, and carolina - chicago. [SEP] however, the final games of the conference are teams in the playoffs, boston, chicago, chicago, chicago, detroit and chicago,, detroit, detroit, detroit and miami. [SEP] \" the problem is that [SEP]", "detok_text": "[CLS]. [SEP] 2. 13 - 2, detroit 7 - 11, detroit 11 - 1 - 2, detroit, s. chicago, detroit 11 - 14 - 1. 26 ). [SEP] the dow jones industrial index dropped by 2. 8 percentage points. [SEP] 18, 2007, is the \"day of the year,\" she said. [SEP] the teams chicago, boston, chicago, boston,, and carolina - chicago. [SEP] however, the final games of the conference are teams in the playoffs, boston, chicago, chicago, chicago, detroit and chicago,, detroit, detroit, detroit and miami. [SEP] \" the problem is that [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] in 50, 50, 60, 60,,,,,,,,,,,, 48, and was a key support for future operations. [SEP] total copies of the numbers are : men ' s 50, 73, 73, 73, 48,, 52, 52, 52, 52, 49, 48, 49, 52, 50, 52, 48, of the total, respectively. [SEP] the numbers 45, 37, 51, 51, 51, 51,,,,,, 18,,,, 18, 37, 37, 37, 37, 37, 37, 37, 52,, 48 [SEP]", "detok_text": "[CLS] in 50, 50, 60, 60,,,,,,,,,,,, 48, and was a key support for future operations. [SEP] total copies of the numbers are: men's 50, 73, 73, 73, 48,, 52, 52, 52, 52, 49, 48, 49, 52, 50, 52, 48, of the total, respectively. [SEP] the numbers 45, 37, 51, 51, 51, 51,,,,,, 18,,,, 18, 37, 37, 37, 37, 37, 37, 37, 52,, 48 [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] in turn. the time with the rest of week - - to - back. to - back - to - back, late - milan - to - boston - again, afternoon - late - night days. [SEP] period days, 36, 36, 27, 26, 37, 37, 37, 31, 37, 37, 45, - 48, 48, 52, 51, 48, 48, 48.... days, 36, days to take over all of the days, december, december,, 38, 36, days to end up with ice - in days, then sit down on the ice. [SEP] he [SEP]", "detok_text": "[CLS] in turn. the time with the rest of week - - to - back. to - back - to - back, late - milan - to - boston - again, afternoon - late - night days. [SEP] period days, 36, 36, 27, 26, 37, 37, 37, 31, 37, 37, 45, - 48, 48, 52, 51, 48, 48, 48.... days, 36, days to take over all of the days, december, december,, 38, 36, days to end up with ice - in days, then sit down on the ice. [SEP] he [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] s., chicago,, chicago,, chicago. [SEP] 8, 14, 2009. [SEP] the worst of the recession is, as a result, the worst of the global downturn. [SEP] take a bottle of the water, the water, the wine, the bread, the milk bottle, the office, the office. [SEP] numbers of, 15, 16,, 13, 15, 17, 17,, 15, 15,, 15, 31,, 15, 15, 21, 18,, 18, 23, 24,, etc., 13, 18, 24,,,,,,,,, [SEP]", "detok_text": "[CLS] s., chicago,, chicago,, chicago. [SEP] 8, 14, 2009. [SEP] the worst of the recession is, as a result, the worst of the global downturn. [SEP] take a bottle of the water, the water, the wine, the bread, the milk bottle, the office, the office. [SEP] numbers of, 15, 16,, 13, 15, 17, 17,, 15, 15,, 15, 31,, 15, 15, 21, 18,, 18, 23, 24,, etc., 13, 18, 24,,,,,,,,, [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] rules in order to comply. [SEP] finally, the moment of relief was one to away. [SEP] and there are more than, think, of, a very few things. [SEP] for now, the cavaliers are back in the lead - -, perhaps, even in the playoffs, though. [SEP] but instead of winning detroit, detroit, miami, detroit ' s - - 14 win at atlanta - - the broncos took their season on top. [SEP] \" in the face of a recession, it is hard to get the economy back to the ground, to get close enough to dry up in the near term, \" said the u. s [SEP]", "detok_text": "[CLS] rules in order to comply. [SEP] finally, the moment of relief was one to away. [SEP] and there are more than, think, of, a very few things. [SEP] for now, the cavaliers are back in the lead - -, perhaps, even in the playoffs, though. [SEP] but instead of winning detroit, detroit, miami, detroit's - - 14 win at atlanta - - the broncos took their season on top. [SEP] \"in the face of a recession, it is hard to get the economy back to the ground, to get close enough to dry up in the near term,\" said the u. s [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] health care. [SEP] the movement in the system is the product of short - term, not short - term ideology. [SEP] he will make, sell, design,, service,, sell, service, and produce, a furniture, kitchen, bakery and services company. [SEP] the problem is similar to the stadium that was built a week after the incident, which came after a 17 - 14 win, 38 - 14 loss in the city. [SEP] this is the amount of warmth and sense of warmth and emotional closeness. [SEP] los angeles - if james brown isn ' t even back in a playoff situation, the cleveland magic can move on to [SEP]", "detok_text": "[CLS] health care. [SEP] the movement in the system is the product of short - term, not short - term ideology. [SEP] he will make, sell, design,, service,, sell, service, and produce, a furniture, kitchen, bakery and services company. [SEP] the problem is similar to the stadium that was built a week after the incident, which came after a 17 - 14 win, 38 - 14 loss in the city. [SEP] this is the amount of warmth and sense of warmth and emotional closeness. [SEP] los angeles - if james brown isn't even back in a playoff situation, the cleveland magic can move on to [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] flight in chicago, and then a private flight to chicago, and a flight from chicago. [SEP] on monday, the president will travel to the capital to lay a three - year wreath on the road to a peace agreement. [SEP] it then translates to 14, 18, 50, 50, and so. [SEP] i have to wait in london for a number of days, week, week - - and he ' s 50, 50, 50, 50, 50. [SEP] he will never have anything. [SEP] it is chicago, chicago, chicago, chicago, chicago, and chicago. [SEP] the midwest region, michigan, chicago, texas, [SEP]", "detok_text": "[CLS] flight in chicago, and then a private flight to chicago, and a flight from chicago. [SEP] on monday, the president will travel to the capital to lay a three - year wreath on the road to a peace agreement. [SEP] it then translates to 14, 18, 50, 50, and so. [SEP] i have to wait in london for a number of days, week, week - - and he's 50, 50, 50, 50, 50. [SEP] he will never have anything. [SEP] it is chicago, chicago, chicago, chicago, chicago, and chicago. [SEP] the midwest region, michigan, chicago, texas, [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] itself as the \" mother of hope. \" [SEP] the rally marked the end of a five - year trend as it turned to the mid - term. [SEP] on a, 14, 16, 16,, 15, 14 - - on a 10, 15, 15, 16,, 16,, 18, 24, at the end - - he seemed to make a point of himself. [SEP] that is a mark of weakness. [SEP] the pillars of the building ' s roof were blown up. [SEP] after the diagnosis, i came back to the hospital to see that i would have a doctor on the way to the hospital. [SEP] [SEP]", "detok_text": "[CLS] itself as the \"mother of hope.\" [SEP] the rally marked the end of a five - year trend as it turned to the mid - term. [SEP] on a, 14, 16, 16,, 15, 14 - - on a 10, 15, 15, 16,, 16,, 18, 24, at the end - - he seemed to make a point of himself. [SEP] that is a mark of weakness. [SEP] the pillars of the building's roof were blown up. [SEP] after the diagnosis, i came back to the hospital to see that i would have a doctor on the way to the hospital. [SEP] [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] $ 150 a ton, about 20 percent of the original cost. [SEP] i would provide an answer to your right question. [SEP] it might well be okay to eat, but not want to go to sleep in front of the sofa. [SEP] in 1919, on the fourth day of december, he died in the palace hotel in london. [SEP] he was returned to the courtroom and in the process had to make the case back again. [SEP] weeks,, weeks,, weeks, or months. [SEP] 21, 2007, when south dakota state police chief jim brown said he made a decision to buy the plane. [SEP] \" it ' s a [SEP]", "detok_text": "[CLS] $150 a ton, about 20 percent of the original cost. [SEP] i would provide an answer to your right question. [SEP] it might well be okay to eat, but not want to go to sleep in front of the sofa. [SEP] in 1919, on the fourth day of december, he died in the palace hotel in london. [SEP] he was returned to the courtroom and in the process had to make the case back again. [SEP] weeks,, weeks,, weeks, or months. [SEP] 21, 2007, when south dakota state police chief jim brown said he made a decision to buy the plane. [SEP] \" it's a [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/state_c256_t1p45_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/state_c256_t1p45_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..64d561c8621efd56a6f0ac616abbd1d9b90ad074 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/state_c256_t1p45_detok_raw_samples.txt @@ -0,0 +1,228 @@ +state_c256_t1p45_detok +{ + "type": "summary", + "name": "state_c256_t1p45", + "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", + "step": 124000, + "decode": { + "kind": "categorical_fullvocab", + "config": "state_c256_t1p45", + "steps": 32, + "model_t_mode": "post", + "support_power": 1.0, + "semantic_power": 1.0, + "endpoint_temp": 1.45, + "concentration_min": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 44.930859242990756, + "nll_per_token": 3.8051248469363923, + "tokens": 9366 + }, + "diversity": { + "sample_entropy": 3.7823763722555808, + "unique_tokens": 1422, + "token_count": 8192, + "distinct_1": 0.173583984375, + "distinct_2": 0.5745570866141733, + "top_token_mass": 0.11572265625 + } +} + +===== sample 000 ===== +[CLS] season, high - season games, it was so good that a lot of them make that impact. [SEP] there is also a little warmth to the young wife, michelle (who is attached to the story, but to the novel, not all of it, too). [SEP] "there will be times when you know you have to put your hat on to you. [SEP]" sometimes we just get off to get around, " he said. [SEP] he did not even let himself in on the side of the court building. [SEP] he finished the night of full - court drama. [SEP] the project, called the development of the research to [SEP] + +===== sample 001 ===== +[CLS] in his room, however, maybe in 1962 - - maybe once a week in 1981. [SEP] and the knicks' trip of the season, back to cleveland, back to the new stadium. [SEP] if it's the perfect time, mix the eggs, add, finally, the flour, and turn over the panes of the flour. [SEP] "i have to go for it," ronaldo said. [SEP] " the government was really prepared to do it. [SEP] this is a new approach. [SEP] however, the man, known as mr colla's lawyer, was unable to make a court statement. [SEP] that ' [SEP] + +===== sample 002 ===== +[CLS] said. [SEP] to do that, there's all the difference. [SEP] at least a half - - some 60 - - are priced at around £1, 000. [SEP] at the start of the show, the performers turned the main arena into a small, box - and - room full of music, love, and bits of a rock star. [SEP] the conservatives, who raised £5. 6m in the past year, said the election result was "unfair." [SEP] since then they are required to admit in their consent that one reflects on them while sitting in the same house. [SEP] ap reporters contributed from gaza. [SEP] meanwhile, [SEP] + +===== sample 003 ===== +[CLS] of the current crisis. [SEP] there is such thing as a mask, a mask, a... " [SEP] at the height of that period, he managed to escape when he was, in fact, known as the bank of england in ireland. [SEP] add together, add bread, bread, butter, the eggs, bacon, the juices, and cheese. [SEP] in a process that takes back to, say, to,, to, to see, the location, not the time, a place where things is going on often, the day is, the is, and the day with an air. [SEP] he would have [SEP] + +===== sample 004 ===== +[CLS] 0830 gmt. [SEP] "we have a lot of time in looking for a new plan, but we have not gone with it with our plan, and we look up with," he said. [SEP] the answer, trying to turn out what it is, often comes on a long day. [SEP] he's had a all - star all - star season break. [SEP] the rest of the day,,,,,,,,,,,,,,,,,,,, i have seen, and said, what it is, opportunity to come, explain, and come and believe it. [SEP] he [SEP] + +===== sample 005 ===== +[CLS] s caffeine, stuck in london, and sat around waiting for several months to move off, before landing in the open in new york and landing, again, in new york with chris stewart and pat williams. [SEP] "if they're going to negotiate, they say'vote for you,'" said wright, on the subject of an interview. [SEP] the center's annual sell - out to a street is for thursday. [SEP] after all, the absence of money from football is significant. [SEP] in some sense, that place has built up a bit of a small space that, a little, of course, a [SEP] + +===== sample 006 ===== +[CLS] over the course of the grind, add the diagonal side, then, in the time, to the horizontal side, begin to. - break a pattern, slice the pastry in a small, again. - - again, again at a 15 - point point, half, half,, half, for a different kind of pattern. - then, as the heel, back in turn, again in the back, to top the line in time. - - the foot's turn to turn, line, turn to, out of shape. [SEP] the answer. [SEP] when i take off it seems to take off again, to the [SEP] + +===== sample 007 ===== +[CLS] losses. [SEP] and they have to remember that their mission was not to invent words but to invent them. [SEP] granted, i see - in, week,, week, there was the only day, in the event of change, of ", for nothing, "of" year, for day at work " and in the game of rest - - well, a good day. [SEP] in fact, the road has to do and the road has to work, but it is not there. [SEP] 7, anaheim 0 (18 - 16 - 30 saves). [SEP] canada, brazil, brazil, thailand, turkey, thailand [SEP] + +===== sample 008 ===== +[CLS] black - headed nabullah khan, a hot - voiced jewish figure who loves one's way of life, are lonely, unable to reveal, literally, brilliantly,, almost sulkly. [SEP] now, the teams have spent years of working out the differences. [SEP] the service includes weeks of driving in one direction, perhaps for the first time, and on - and drive - in between hours. [SEP] weaver, who hit a two - run rbi homer and an rbi homer, closed to a perfect 10 for the first time since. [SEP] it's because the democrats are just a drain on democracy, and it is [SEP] + +===== sample 009 ===== +[CLS] bill that went back - to - back investigations in 2004. [SEP] i wonder if they will do the same this time. [SEP] we have in days, days, then days, weeks and back in the air. [SEP] it's a forced - to - go back - to - back, you have a good idea. [SEP] now, the magic has gone out of fashion, - - - - - - - - - - - - - - - - - - - - - - - - - for a quarter - and - half - and - a - half -, the whole end of the whole, 2008, a little [SEP] + +===== sample 010 ===== +[CLS] day, brings to mark the record of the 16 - year - old order. [SEP] he is likely to have gone to the moon in space. [SEP] mr brown said the us would not talk until the vote - counting was made in january. [SEP] the man's son's wife who lived in the city centre has moved up on a trip to chicago, and his family is home in east heath, ma. [SEP] that, after two 14 - game losses to the celtics' nemesis, the pistons and the washington bulls, resulted in a seven - game series, not three games. [SEP] the network's chief fire officer, [SEP] + +===== sample 011 ===== +[CLS] said it was making the decision to suspend operations. [SEP] it has to change... and it's just a day - by - day - by - day for your people to vote... ("is over").. [SEP] add the breads, then green, then, pre - season, bring over the butter with a small plate, then make a mix - - stirring, place in the oven, then until, stirring. [SEP] hill, who lost his right job monday, is on the road trip to his nemesis, the white sox. [SEP] " i'm sure everyone knows it. [SEP] his [SEP] + +===== sample 012 ===== +[CLS], can provide that kind of protection. [SEP] a slice - and - paste bag of paper was used to support the cabinet. [SEP] in fact, the ensuing bust - up led to the battle. [SEP] the journey of the island is not easy. [SEP] mix in a mixture of garlic, chilied, zeal, juice, black flour, red onion, cinnamon, garlic, cred, sugar - flour, tomato, tomato, and garlic, all of all in the water. [SEP] bring to the boil - - cover with the brown flour. [SEP] they do have the ability to sort the crap out of the system. [SEP] " [SEP] + +===== sample 013 ===== +[CLS] a lot of the journey to the idea of the most famous place, days, days.... and well, you would have to stop the place. [SEP] it is no longer clear that she was never dressed in the way it must have been at all before her. [SEP] it was at boston, detroit, cleveland - - - - - - - detroit, cleveland, chicago, miami, cleveland, the final days of the road game, boston - chicago, boston - - - in new york, chicago, chicago. [SEP] bobcats 100, denver 100: james wallace had 16 points and 10 rebounds. [SEP] for example, [SEP] + +===== sample 014 ===== +[CLS] in black, with the long eyes. [SEP] just place, in, together, on the tray, then grind - in place, place on the top, and back on the thin side. [SEP] sometimes, just sometimes - - just in the air, sometimes - - sometimes, just in the office, not ice, but i think i understand that you have to get back to the weekend,,,, back - then... and about 90 percent of that.... [SEP] the main line, which started friday, is a short - line of 2, 000 feet, the size of 1, 000 meters ( 2 [SEP] + +===== sample 015 ===== +[CLS] [SEP] brown, 17 years old, has admitted to the court to the charges, but has not responded to any charges. [SEP] monday, september 26, 2008, october 31, 2008. [SEP] "we will have to plant 10, 000 vehicles by the end of 2011, to be taken into production," he added, referring to projects in the east.. [SEP] the black and powdered buses rolled along the roads in china's capital, many of the trucks, and dozens of bridges, at the facades of government buildings. [SEP] "i have a crush, i need a vomit," his father said. [SEP] he, [SEP] + +===== sample 016 ===== +[CLS]. [SEP] i can't blame it to have to wait to tell people who all do. [SEP] the green clouds looked ominously over the tree, while the buildings moved from the first step toward their descent to trees. [SEP] i do want to know if you have an idea. [SEP] from the beginning, jim bradley's coffin, pinned to the name of willie walsh, was, if visible. [SEP] 1, for days 1, 1, 2003,, and 2008. [SEP] the 12 - week period was tendered for just two days and, for the first time, eight days, all due to the disruption, the commission [SEP] + +===== sample 017 ===== +[CLS] way, she's going to raise her head again, before going to pay attention that some of her best friends are going to make a try for you - - just to make it. [SEP] the stock market goes back a week after week, the reserve bank of chicago, week - week, week - week - - - - month. [SEP] weeks and days, i have walked back, again, to sleep. [SEP] the planes, planes,,, planes,,,,,,, the planes,,,,,,,,,,,, etc. [SEP] if you are on an unusual vacation, you can [SEP] + +===== sample 018 ===== +[CLS]daq. cash & e decreased by 4. 14 % to 4. 40 per share. $1, 3663 million, with cash flow charge continuing back to 65 %. balance by 2q0 _ 2009 - - c -0, the energy department. report. [SEP] pieces, including the skeletons, were separated into the remains of the plane, a line on the ground, half, half - - half, more than a half - minute longer than normal. [SEP] peanuts, f - 16s, crams, dunk, gap, bla, and paper - - - just a piece of weight, [SEP] + +===== sample 019 ===== +[CLS] report. [SEP] the colors of 70, 50 - 76, 80, 70 - 70, and other colors were noted for black, black, 60 - in, 50 - in, 60 - in, 60 - in -, 60 -, 60 -,, 60 -, -, 50 -, 50 -,, 60 -,, 50 -,, etc. [SEP] the magic led, 15 - 14, as the favorite to change cleveland's schedule. [SEP] what is said, to come, to write, to speak, is nothing,, not, nothing. [SEP] he also told potential investors that hefty profits [SEP] + +===== sample 020 ===== +[CLS] - - and the rest of the day - - in the same period. [SEP] ready - to - boil bread, bread - to - bread and ice bread, for example, are all - in - place bread, with deulated carrots to which they add. [SEP] in the end - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -... - - - - - - - - - - - - - - - - cut the breads and into a dish. [SEP] and in the know - [SEP] + +===== sample 021 ===== +[CLS] the pakistani leader. [SEP] he said. [SEP] after the kabul government abruptly shut down the country's three schools, however, the problem closed july 4, 2008. [SEP] these days, that has sent a second official to the city council, which declared in august that the building was mr. ameshi's "district council." [SEP] " there are not days, not days, of belief. [SEP] the number of women in england has been reduced to higher than at any time to higher education, the report said. [SEP] q: time for a 60, 50 and 50 years. [SEP] ann arbor, mich., [SEP] + +===== sample 022 ===== +[CLS], ill., with the same black vote (13. 7). [SEP] following a flight from the capital, in central africa, the aircraft will travel to london instead of flight, and then then flying to washington to london, on a first trip. [SEP] they are happy have a car, not have a dog they feel is good to offer them something. [SEP] half of the men who appeared with cuts to a range of 50m or less were described as the type - - with short build and more than vision. [SEP] 60, 80, 60, 50, 50, - - we need to get together in a minute, [SEP] + +===== sample 023 ===== +[CLS] up three areas of the country, that provided about 70 per cent of the votes for the march election. [SEP] azuz: it's a beautiful day - - chicago, massachusetts, etc. [SEP] the car then turned up "instinctively," and the thief turned to the line, she said. [SEP] in jackson, ga., a co - employee was arrested days after he was injured on interstate 2. [SEP] he is unable to explain the convictions he had a week before being arrested in connection with the death of a 3 - year - old boy in 2004. [SEP] not so much flour, but butter - - flavored with [SEP] + +===== sample 024 ===== +[CLS] to a 20 - 7 run... [SEP] as a child, my days at the airport, including in london and switzerland, and my 13 days in the hospital, germany, i've been cut from it and i'm very happy to get back in touch with them. [SEP] come on, time, time, day, lots of days, come out to the end of... a period of time we have, days, they have again,, it would be a little days, in time and again, in two and a half, the staff are being left to work. [SEP] even the american coach, [SEP] + +===== sample 025 ===== +[CLS] order. [SEP] if a guy was on the ground, he would look out on the wrong road. [SEP] and everything was down, just at home to chicago (this one) and all the above guys would have to throw in. [SEP] i don't think there is a way yet, try to put the lead - off, 18, 14, 14, 1 - 14, 11, 14, 11, 14 - 10, that's even do it to the end of the whole season. [SEP] " it seems that we have the right thing to do, just to say,, to say, we'll have to [SEP] + +===== sample 026 ===== +[CLS] 74, spent the end of his half - life as a military man. [SEP] many young people to take up work - day, after - school or evening hours, or return to work for school holidays after being cut by the city government. [SEP] i wish i have had a little more time there before we heard him go, " she said. [SEP] it is one - packed, it just looks obvious, and not the end - to - end thing. [SEP] he was hit just three times in a second - round game on the road for his team in the first round of 2004 - 97. [SEP] on sunday, chicago and chicago [SEP] + +===== sample 027 ===== +[CLS] are not known. [SEP] but, yes, we can't be the kind of thing that we can understand, that's not a good thing. [SEP] if you call it a fire for such people, the physical process is something different for a us soldier. [SEP] "the shares are at a half - point," said a trader. [SEP] and again, he's just right. [SEP] he added that diplomacy is the only way to get us to do what he wants. [SEP] "but short - talk is the best way to get going," he said. [SEP] it may just be time for an eye - to [SEP] + +===== sample 028 ===== +[CLS] the house has to packed up, the owner told me yesterday, but then he has a place to cover their windows and in winter at night he can turn their lights out. [SEP] "i walked in a pretty nice way." [SEP] the stadium, which has been synonymous with tradition since 1973, arrived in the opening round of competition for the first time at center field in chicago, in the same, the loss of the old ground to a 17th division championship. [SEP] the barclays seemed to keep showing up at all. [SEP] here in london, i make a joke, about christmas, christmas, and christmas pudding. [SEP] he was [SEP] + +===== sample 029 ===== +[CLS] too bad. [SEP] for one - - though, they won't be forgotten. [SEP] and the penguins are out of the playoffs - - line, line by area and point, area by area. [SEP] it was to be a great effort, and that was to get on a plane to a... on the plane, to try and end the argument. [SEP] the u. s. refused to be requests to comment. [SEP] it's a little weird day - to - day.... i just talked to someone beforehand on when to turn and how to get to in time. [SEP] a: we do know [SEP] + +===== sample 030 ===== +[CLS] to cool relations. [SEP] these kids have no time to get together. [SEP] by now, the government had been made to remember the word, "taking the shower," by mr heaney, who was served as the prisoner of war. [SEP] it is a bit harder to get in the race. [SEP] finally, she did in a state of shock. [SEP] the company, meanwhile, made chairs, shoes, linens, chairs, and wipers, all, and place, a mattress manufacturer, moved from dry to dry to fresh snow. [SEP] " we went to a three - day conference - style conference on saturday, [SEP] + +===== sample 031 ===== +[CLS], blessings in the choir and, like him, a church. [SEP] there is a feeling, "they give you a lift," he added, "in the words, in english," red, white and white. [SEP] without it, it is not an all - american - style bread with a knife and baking flour. [SEP] the marbles were conspirated in china and argentina (they were wooden furniture and displays of life at auschwitz during world war ii). [SEP] he didn't sit and do the day's work and out of the bedroom, and he was on the floor. [SEP] the u. [SEP] + +===== sample 032 ===== +[CLS] to 1968, to the end of 1963, to the french point - - "oh, again. [SEP]" it seems... [SEP] even if not, " the bill will never be signed into law. [SEP] the company hopes that the figures can help to double its forecast of full - month sales since the recession began in january because of an 80 per cent increase the previous year expected. [SEP] on this day it seems so obvious he would be climbing, toe - twisting,, writing down the top, standing down to the back door, a white hat, a dog, in all, a black hat, and a dog, [SEP] + +===== sample 033 ===== +[CLS] - two weeks or a step ahead of schedule while on the ground, the house is open, along with the roof, roof, the roof and the central units. [SEP] both playwrights met with a friend, and they began to work together. [SEP] we got in travel. [SEP] but, now, the pain is greater than he had to lay his home for 10 hours. [SEP] the nets won three of in all of sept. [SEP] in chicago, he won the previous two, in chicago, then, to detroit in december. [SEP] beijing (ap) - - a little mask might seem to make a difference, the u. [SEP] + +===== sample 034 ===== +[CLS] have thought for now, even in the deep dark, of the story's glory. [SEP] of that, there are a total of 1, 000... [SEP] 1 ), at the boil, in turn, for a day, is as big as a pan of red bread, and no gas is needed. [SEP] " it's important that we can have a genuine resolve. [SEP] whether this is a really bad line, or not. [SEP] she even gets to sing for the new group - - 'my friends'. [SEP] however, he said, the new vote has failed to a date. [SEP] and then, [SEP] + +===== sample 035 ===== +[CLS] to help a person buy,, well, a rubber chair, or two - pack of pillows. [SEP] the panel wanted to act, just to sort it out a bit, and i decided this to be a way to keep the conversation going for years. [SEP] it was like, late into the day, you have to work hard together.... [SEP] however, he is the type to work, and he still needs to go out and get his way around. [SEP] i, up again and again, that day, afternoon and afternoon, and, after the week, the day, the day after, i went to the [SEP] + +===== sample 036 ===== +[CLS] all ages. [SEP] mr. lecce. [SEP] of course, he is wrong, but he is a joke. [SEP] i think that, a lot, has to be said, and wait, there are some options for change, so that we are having a referendum on things. [SEP] but still, look a little closer, especially in the first half, and you will be able to get down for you. [SEP] in fact, i can e - type it on the allergy in relation to the bread, butter, chit, milk, cheese, and bread - cheese. [SEP] the association also calls for councils to pay [SEP] + +===== sample 037 ===== +[CLS] ago, but that was not even a good story. [SEP] as bernanke is known, brown, brown, brown, brown, brown, brown, the rat, the dumpling, the swi, the bakek - dog, the sheep, the goats, the sheep, and the dog, the bi - racial - etc. [SEP] "we are here for day, day, night, and night. [SEP]" not one, not one - - maybe he can be a defender, " he said. [SEP] mr brown also warned he would not face difficult working conditions for the afghan police forces, even if he had [SEP] + +===== sample 038 ===== +[CLS] sort of pushed back three times in over a week but had to take his chance to drop out of the race. [SEP] "the first shot from the beginning, the one - hit, the more than 500, the jets, the nets, the celtics, and they're all together," he said. [SEP] jason satter was the director of the 15 - year - old in the history of the golden states, and was a producer on the 20 - member project. [SEP] a row of students and two staff took place at the end of the school in february 2006. [SEP] a liar, " he will not have the beans [SEP] + +===== sample 039 ===== +[CLS] road. [SEP] the magic led, 38 - 17, including 15 points into the game. [SEP] the bottom line is that the day is the last week, period, and then you get out the window... [SEP] i.... trains, planes and, of course, road cars, roads, buses, trains, and trains. [SEP] government officials have said the plane had begun delivering back to the airport in 2004, but that the flight - 93 was named for the repair crew. [SEP] yeah, the fat - duck question needs to be answered and put in the... [SEP] it's gone on, but [SEP] + +===== sample 040 ===== +[CLS] from time to time to in..... then again, that was the tv at the time to turn to day to day - - right before the screen. [SEP] it is the moment in front of the start of a meal and by the end, just to make a basket at the end. [SEP] the other aircraft did not show up at to 1, 000 feet, or by helicopter. [SEP] he wanted to hold his breath when the news fell out, before getting off to end when he was not going to start again. [SEP] it was a black, back in 2003, a pre - season, half - in. [SEP] + +===== sample 041 ===== +[CLS], on the edge of the pool in the double - story bed, sits on a piece of deep - brown paper. [SEP] on the other side of the road some of the anti - protesters protest at the soldiers' deaths. [SEP] and it might have had to do to the big time, non - money - - the whole thing has never stopped. [SEP] but in the end, it was usually, just once a year, but a year later, for a lot of months now, and a three years later, it will never have been again. [SEP] but for a moment we just have begun. [SEP] the 36 - year - [SEP] + +===== sample 042 ===== +[CLS] championship, and sports council officials said johnson's focus was beyond on four games, three - hour games, two games and a one - game - - two - week event. [SEP] it's 1, 000 acres, a 100, 000 - acre area. [SEP] however, for good, everything, which seems like nothing, is rubbish. [SEP] "we are already in the works to have something to go down, a lot to move in with us. [SEP]" the thought was' yes, if they come out, " he said. [SEP] the cause of the crash, which happened a couple of hours after the road was [SEP] + +===== sample 043 ===== +[CLS], have to sell their money in a country, for free, or for the eu, or in italy. [SEP] that said it was the place to be done, and to feel, in a cold local room, we would take a few hours to try out the cheese, place and place it together on a final package, a black - white dip, half - red meats, carrots and salt, vanilla and black - pepper. [SEP] the federal government's new savings figure, released in february, fell sharply from the 7. 9 percent - year figure from the same period in november last year. [SEP] " at the [SEP] + +===== sample 044 ===== +[CLS] 3 days, days, days, days, 14 days..... and 4 days, 3 days, 2 days, days, 2 days, days, 3 days, 14 days, days, days, 2 days, 2 days, days, days, days, 11 days, days, days, 12 days, 4 days, days, 4 days and 4 days, days, days, back together on a normal days, and 2 hours and days in hours, days, days. [SEP] then, come the sun the sun, and then there is a little bit of sun. [SEP] that's a great idea to [SEP] + +===== sample 045 ===== +[CLS], according to the international monetary bank. [SEP] they said in a statement that there is a lot of evidence in their efforts to move on the issue. [SEP] it turns out that the race line is written in real knots. [SEP] today, we are in the mid - 50, 50,, 50, a year of the day. [SEP] 4, 2, 10, 15, 14, 17,, 16, 15, 21, 15, 26, 15,, 15, 16, 15, 49, 37. [SEP] in the summer of 2008, rbs reported $90, 000 in security costs between now and december 2000, [SEP] + +===== sample 046 ===== +[CLS] home -owners, welfare and jobs ). [SEP] it seems that the security measures are most likely to be put in place up to now. [SEP] the sense of fear surely will not gain before the minds of students return to participating in their school life. [SEP] with a little more depth,, then, then, sometimes, and sautes. [SEP] pittsburgh, panthers 2 mike danley got the second goal and five assists in a 2 - 2 victory, and mike fisher scored the first - goal early of the game to seal the win. [SEP] then, a remember... the boys come into love with me. [SEP] [SEP] + +===== sample 047 ===== +[CLS] in advance of the christmas olympics. [SEP] the bread is crisp on the outside, with the top with all the butter and juices - - to return in a small pan to the bottom. [SEP] he led his club to the conference floor when the game ended. [SEP] but, it's hard to imagine the americans making such a point. [SEP] the service sector and the contract are expected to reach a 16. 0 - m (1) - 3m depth at the time (16. 2m). [SEP] for some of these, he just turns to,'s (er), and he is.... [SEP] + +===== sample 048 ===== +[CLS],,,,,,,,,,, and the end. - - - - - down the road.. - -, well, we're going to get a more field day in the end, some point, maybe, and we will have to buy a real plan, but we have a better day with a better picture. [SEP] 4 (upi) - - toronto blue bulls, u. s. team toronto, bulls - - the bulls was back in boston for the second straight no. 1. [SEP] " the situation goes back to 1997. [SEP] so, these days, the creation of a group [SEP] + +===== sample 049 ===== +[CLS]. [SEP] if we stick to a similar conversation, then say, " that was, to be more casual, what we all wanted to do. [SEP] the course of everything, the start of the week at the end of the day, for days, and then again in year, week, after day. [SEP] at the end of september 2009, there was the increase in additional loan losses at an average value of $4. 8 million, up from $11. 9 million, in the same period of 2009. [SEP] the shares need to be sold - - or, say, a better - - sold. [SEP] 1845: we [SEP] + +===== sample 050 ===== +[CLS] he brought down the front page is... [SEP] sevek, 13: 10 minutes - - half, half, half, half and half - again, but it was about half - hour, half - time. [SEP] by day, day, day of the week, half - day, wake - up period, how much that time, how little is changed in. [SEP] finally, instead of a minute - just long enough to forget and take a further look at it. [SEP] instead, they are learning to put on the bed, so go to bath, in which they have access to get paid to a play. [SEP] + +===== sample 051 ===== +[CLS], 24, of leytons, was arrested. [SEP] then 65, 65, 60, 50 in the morning and then half - 52.... for the afternoon, -..., - - 50, 50, a - 60, a - 52, the celtics were 50, 60, 50, 50, and 50 - - and, after all, 50, 50 - - 50, 50, 60, 50, 50,, 52. [SEP] today, a week, 24, 40, 37, 50, 50, and time in the afternoon, for 30 to 45 seconds. [SEP] in australia, the [SEP] + +===== sample 052 ===== +[CLS] - hour, 80 - mile journey, taking nearly a year to get by. [SEP] the fall - off corruption trial took place when the court heard that a brazilian businessman had lost over 25, 000 hectares worth of land. [SEP] all his work, the wooden structure - - based on long, period structure - - became the story of the installation. [SEP] easttown, s. s. vancouver, sept. [SEP] while he's just for christmas - - the end of the christmas season - - his son, chris, has had a decent campaign this week - - perhaps. [SEP] 4 (upi) - - u. s [SEP] + +===== sample 053 ===== +[CLS] typically trade in at 90 % - 40 % in current market prices, and do not rise until further in the winter. [SEP] put out of the juices, cut in a large saucepan, and season the butter and ice at half - hour time. [SEP] and the same thing could have happened.... [SEP] in a bowl, place for a close and reduce to half - size flour, bring in a place, so that is a more satisfying choice for the whole family. [SEP] ian wexer, a researcher with the medical office, examined the children in one of their studies. [SEP] the move came to months in [SEP] + +===== sample 054 ===== +[CLS]. [SEP] yes, " white house spokesman gordon young said. [SEP] so clearly, for after days, the perfect time to go, to take the trail back to, after dark, back in the dark place. [SEP] he tells us, and, then, then, why not only is he mean, really, but also he, he said, he is. [SEP] a pan of coconut butter hung on the right side of a rice, thin - scented baking machine. [SEP] unfortunately, america is unable to stand the balance again (and then again, of course,, again, again and again) on the line to the original and [SEP] + +===== sample 055 ===== +[CLS]. [SEP] 2. 6bn ) to multi - year investment gains made in the last three years, up to 0. 6 per cent year - on - year, year - to - year - to - date up from 4. 7 per cent in 1998 - 07. [SEP] "business travel is driven by entrepreneurship," she said. [SEP] i've had to say everything, and we've got to talk. [SEP] however, according to his brother david, who led the investigation, "he was able to go back.. [SEP] and then again, then, now, now and again. [SEP]" if i could get [SEP] + +===== sample 056 ===== +[CLS] in traditional schools. [SEP] shoes are often visible - - and largees of shoes, blankets, harnesses and linens are just to follow. [SEP] "we took some of the essence of the show's character from time to time to time," he says. [SEP] if you want to act, let us laugh, feel, talk, think - - eat, to get home and a bit of sleep. [SEP] today, here he was by side, in the back - room, in a short, quiet place in the middle of night, and in the centre of the evening, he can be, for days, a [SEP] + +===== sample 057 ===== +[CLS] period, and the time to,,,,,,,, starting with a week,,, no one,,,,,... and, then, again, the rest is enough to do everything again... [SEP] it is very bad and wants to do it more efficiently. [SEP] the work of dr. spitz, a mathematician, who jumps and writes,,,,,, days in the back of a plane, takes for a lot of days for the beginning, then, sometimes, then,, to come up with check - in beginning, then set up on a path in the end [SEP] + +===== sample 058 ===== +[CLS] s way of things, which is his own goal. [SEP] it is a great indeed. [SEP] the good thing is, remember, if a coach is get out of the deal, but he has hit over the top of it in the deal, that he makes the deal again, on the plane, on dhl today. [SEP] 2007 - - - - - - - - - - - - - - - - - - as of december 31, 2007, 31 - 2007 - 13, 0230 - £29, 000 - £175, 000, in 2008 - 31, 000 - 300. the actual number 501 ( 1 [SEP] + +===== sample 059 ===== +[CLS] 2010, it is clear. [SEP] however, the end of 2006 was a first step. [SEP] and there is more to come to make of, and very few excuses. [SEP] in fact, the crowd roared and then finally brought it to a halt, quickly turning the show into again. [SEP] the producers realize, however, that works like pillows and rinses are just examples of a child stopper's passion for child care. [SEP] "in the face of this road, i urge you to read this constitution, to make sure to be better, working, to get better and stay better," said the u. s [SEP] + +===== sample 060 ===== +[CLS] health care. [SEP] i sat in the office for a minute of a single day, when he wanted to look me in the mirror, and got the answer. [SEP] the man who wrote, and spoke in italian, a fake and a fake, was photographed with the minister's apron, and the answer was written in white. [SEP] the forecast is expected to bring to 10 - 15, 000 tonnes of power capacity in the second quarter. [SEP] that means a top aide revenue rate of an additional 11 percent. [SEP] los angeles - the celtics have stumbled to a first victory in a playoff game, the first coming at the end of [SEP] + +===== sample 061 ===== +[CLS] stories and poetry, and so there are people to find historical and useful items from history. [SEP] in addition, the national civil' union, john kelly, wanted to make a comment on the deal in return so that companies would not be able to fund large "post - contract" - related work. [SEP] he told bbc news "one of a number of members at the wirral trust has been campaigning in favour of extending the line service. [SEP] i know, that is incredible. [SEP] so - - well, it would be that he has to" reckoned with respect " and the rest has to stop. [SEP] but then, [SEP] + +===== sample 062 ===== +[CLS] well as the nation, " he said. [SEP] the day's event was a two - hour period as it turned into a start - off. [SEP] then a - 4,, 5, 5, 5, and - - on a 10 - yard,, 11, 13, 100 - yard, and yard rally from a 10 - point, 11, for - 10 news conference. [SEP] it is a change of direction. [SEP] the majority of the bank's assets are in commercial mortgage - backed commercial securities, with most assets in relation to mortgage - backed securities, including fixed - income and other junior mortgages. [SEP] [SEP] + +===== sample 063 ===== +[CLS] $15 billion, down earnings a share in the first quarter. [SEP] i was not sure to look at, anywhere in his face - and then, and gone along with his way to talk about the job. [SEP] he just seems not to believe it's true. [SEP] so why do they want me to take the other children to their school and to the house and i'd have to watch the same thing again. [SEP] a police spokesman said: " this is an incredible mix of dark, orange, and blue, and like. [SEP] i feel like, i wonder why the council might want to turn it into a less [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/state_c256_t1p45_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/state_c256_t1p45_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..1451e68fc5003f822f2715738491a32bc6c2c6a7 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/state_c256_t1p45_raw_samples.txt @@ -0,0 +1,228 @@ +state_c256_t1p45 +{ + "type": "summary", + "name": "state_c256_t1p45", + "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", + "step": 124000, + "decode": { + "kind": "categorical_fullvocab", + "config": "state_c256_t1p45", + "steps": 32, + "model_t_mode": "post", + "support_power": 1.0, + "semantic_power": 1.0, + "endpoint_temp": 1.45, + "concentration_min": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 44.930859242990756, + "nll_per_token": 3.8051248469363923, + "tokens": 9366 + }, + "diversity": { + "sample_entropy": 3.7823763722555808, + "unique_tokens": 1422, + "token_count": 8192, + "distinct_1": 0.173583984375, + "distinct_2": 0.5745570866141733, + "top_token_mass": 0.11572265625 + } +} + +===== sample 000 ===== +[CLS] season, high - season games, it was so good that a lot of them make that impact. [SEP] there is also a little warmth to the young wife, michelle ( who is attached to the story, but to the novel, not all of it, too ). [SEP] " there will be times when you know you have to put your hat on to you. [SEP] " sometimes we just get off to get around, " he said. [SEP] he did not even let himself in on the side of the court building. [SEP] he finished the night of full - court drama. [SEP] the project, called the development of the research to [SEP] + +===== sample 001 ===== +[CLS] in his room, however, maybe in 1962 - - maybe once a week in 1981. [SEP] and the knicks ' trip of the season, back to cleveland, back to the new stadium. [SEP] if it ' s the perfect time, mix the eggs, add, finally, the flour, and turn over the panes of the flour. [SEP] " i have to go for it, " ronaldo said. [SEP] " the government was really prepared to do it. [SEP] this is a new approach. [SEP] however, the man, known as mr colla ' s lawyer, was unable to make a court statement. [SEP] that ' [SEP] + +===== sample 002 ===== +[CLS] said. [SEP] to do that, there ' s all the difference. [SEP] at least a half - - some 60 - - are priced at around £1, 000. [SEP] at the start of the show, the performers turned the main arena into a small, box - and - room full of music, love, and bits of a rock star. [SEP] the conservatives, who raised £5. 6m in the past year, said the election result was " unfair. " [SEP] since then they are required to admit in their consent that one reflects on them while sitting in the same house. [SEP] ap reporters contributed from gaza. [SEP] meanwhile, [SEP] + +===== sample 003 ===== +[CLS] of the current crisis. [SEP] there is such thing as a mask, a mask, a... " [SEP] at the height of that period, he managed to escape when he was, in fact, known as the bank of england in ireland. [SEP] add together, add bread, bread, butter, the eggs, bacon, the juices, and cheese. [SEP] in a process that takes back to, say, to,, to, to see, the location, not the time, a place where things is going on often, the day is, the is, and the day with an air. [SEP] he would have [SEP] + +===== sample 004 ===== +[CLS] 0830 gmt. [SEP] " we have a lot of time in looking for a new plan, but we have not gone with it with our plan, and we look up with, " he said. [SEP] the answer, trying to turn out what it is, often comes on a long day. [SEP] he ' s had a all - star all - star season break. [SEP] the rest of the day,,,,,,,,,,,,,,,,,,,, i have seen, and said, what it is, opportunity to come, explain, and come and believe it. [SEP] he [SEP] + +===== sample 005 ===== +[CLS] s caffeine, stuck in london, and sat around waiting for several months to move off, before landing in the open in new york and landing, again, in new york with chris stewart and pat williams. [SEP] " if they ' re going to negotiate, they say ' vote for you, ' " said wright, on the subject of an interview. [SEP] the center ' s annual sell - out to a street is for thursday. [SEP] after all, the absence of money from football is significant. [SEP] in some sense, that place has built up a bit of a small space that, a little, of course, a [SEP] + +===== sample 006 ===== +[CLS] over the course of the grind, add the diagonal side, then, in the time, to the horizontal side, begin to. - break a pattern, slice the pastry in a small, again. - - again, again at a 15 - point point, half, half,, half, for a different kind of pattern. - then, as the heel, back in turn, again in the back, to top the line in time. - - the foot ' s turn to turn, line, turn to, out of shape. [SEP] the answer. [SEP] when i take off it seems to take off again, to the [SEP] + +===== sample 007 ===== +[CLS] losses. [SEP] and they have to remember that their mission was not to invent words but to invent them. [SEP] granted, i see - in, week,, week, there was the only day, in the event of change, of ", for nothing, " of " year, for day at work " and in the game of rest - - well, a good day. [SEP] in fact, the road has to do and the road has to work, but it is not there. [SEP] 7, anaheim 0 ( 18 - 16 - 30 saves ). [SEP] canada, brazil, brazil, thailand, turkey, thailand [SEP] + +===== sample 008 ===== +[CLS] black - headed nabullah khan, a hot - voiced jewish figure who loves one ' s way of life, are lonely, unable to reveal, literally, brilliantly,, almost sulkly. [SEP] now, the teams have spent years of working out the differences. [SEP] the service includes weeks of driving in one direction, perhaps for the first time, and on - and drive - in between hours. [SEP] weaver, who hit a two - run rbi homer and an rbi homer, closed to a perfect 10 for the first time since. [SEP] it ' s because the democrats are just a drain on democracy, and it is [SEP] + +===== sample 009 ===== +[CLS] bill that went back - to - back investigations in 2004. [SEP] i wonder if they will do the same this time. [SEP] we have in days, days, then days, weeks and back in the air. [SEP] it ' s a forced - to - go back - to - back, you have a good idea. [SEP] now, the magic has gone out of fashion, - - - - - - - - - - - - - - - - - - - - - - - - - for a quarter - and - half - and - a - half -, the whole end of the whole, 2008, a little [SEP] + +===== sample 010 ===== +[CLS] day, brings to mark the record of the 16 - year - old order. [SEP] he is likely to have gone to the moon in space. [SEP] mr brown said the us would not talk until the vote - counting was made in january. [SEP] the man ' s son ' s wife who lived in the city centre has moved up on a trip to chicago, and his family is home in east heath, ma. [SEP] that, after two 14 - game losses to the celtics ' nemesis, the pistons and the washington bulls, resulted in a seven - game series, not three games. [SEP] the network ' s chief fire officer, [SEP] + +===== sample 011 ===== +[CLS] said it was making the decision to suspend operations. [SEP] it has to change... and it ' s just a day - by - day - by - day for your people to vote... ( " is over " ).. [SEP] add the breads, then green, then, pre - season, bring over the butter with a small plate, then make a mix - - stirring, place in the oven, then until, stirring. [SEP] hill, who lost his right job monday, is on the road trip to his nemesis, the white sox. [SEP] " i ' m sure everyone knows it. [SEP] his [SEP] + +===== sample 012 ===== +[CLS], can provide that kind of protection. [SEP] a slice - and - paste bag of paper was used to support the cabinet. [SEP] in fact, the ensuing bust - up led to the battle. [SEP] the journey of the island is not easy. [SEP] mix in a mixture of garlic, chilied, zeal, juice, black flour, red onion, cinnamon, garlic, cred, sugar - flour, tomato, tomato, and garlic, all of all in the water. [SEP] bring to the boil - - cover with the brown flour. [SEP] they do have the ability to sort the crap out of the system. [SEP] " [SEP] + +===== sample 013 ===== +[CLS] a lot of the journey to the idea of the most famous place, days, days.... and well, you would have to stop the place. [SEP] it is no longer clear that she was never dressed in the way it must have been at all before her. [SEP] it was at boston, detroit, cleveland - - - - - - - detroit, cleveland, chicago, miami, cleveland, the final days of the road game, boston - chicago, boston - - - in new york, chicago, chicago. [SEP] bobcats 100, denver 100 : james wallace had 16 points and 10 rebounds. [SEP] for example, [SEP] + +===== sample 014 ===== +[CLS] in black, with the long eyes. [SEP] just place, in, together, on the tray, then grind - in place, place on the top, and back on the thin side. [SEP] sometimes, just sometimes - - just in the air, sometimes - - sometimes, just in the office, not ice, but i think i understand that you have to get back to the weekend,,,, back - then... and about 90 percent of that.... [SEP] the main line, which started friday, is a short - line of 2, 000 feet, the size of 1, 000 meters ( 2 [SEP] + +===== sample 015 ===== +[CLS] [SEP] brown, 17 years old, has admitted to the court to the charges, but has not responded to any charges. [SEP] monday, september 26, 2008, october 31, 2008. [SEP] " we will have to plant 10, 000 vehicles by the end of 2011, to be taken into production, " he added, referring to projects in the east.. [SEP] the black and powdered buses rolled along the roads in china ' s capital, many of the trucks, and dozens of bridges, at the facades of government buildings. [SEP] " i have a crush, i need a vomit, " his father said. [SEP] he, [SEP] + +===== sample 016 ===== +[CLS]. [SEP] i can ' t blame it to have to wait to tell people who all do. [SEP] the green clouds looked ominously over the tree, while the buildings moved from the first step toward their descent to trees. [SEP] i do want to know if you have an idea. [SEP] from the beginning, jim bradley ' s coffin, pinned to the name of willie walsh, was, if visible. [SEP] 1, for days 1, 1, 2003,, and 2008. [SEP] the 12 - week period was tendered for just two days and, for the first time, eight days, all due to the disruption, the commission [SEP] + +===== sample 017 ===== +[CLS] way, she ' s going to raise her head again, before going to pay attention that some of her best friends are going to make a try for you - - just to make it. [SEP] the stock market goes back a week after week, the reserve bank of chicago, week - week, week - week - - - - month. [SEP] weeks and days, i have walked back, again, to sleep. [SEP] the planes, planes,,, planes,,,,,,, the planes,,,,,,,,,,,, etc. [SEP] if you are on an unusual vacation, you can [SEP] + +===== sample 018 ===== +[CLS]daq. cash & e decreased by 4. 14 % to 4. 40 per share. $ 1, 3663 million, with cash flow charge continuing back to 65 %. balance by 2q0 _ 2009 - - c -0, the energy department. report. [SEP] pieces, including the skeletons, were separated into the remains of the plane, a line on the ground, half, half - - half, more than a half - minute longer than normal. [SEP] peanuts, f - 16s, crams, dunk, gap, bla, and paper - - - just a piece of weight, [SEP] + +===== sample 019 ===== +[CLS] report. [SEP] the colors of 70, 50 - 76, 80, 70 - 70, and other colors were noted for black, black, 60 - in, 50 - in, 60 - in, 60 - in -, 60 -, 60 -,, 60 -, -, 50 -, 50 -,, 60 -,, 50 -,, etc. [SEP] the magic led, 15 - 14, as the favorite to change cleveland ' s schedule. [SEP] what is said, to come, to write, to speak, is nothing,, not, nothing. [SEP] he also told potential investors that hefty profits [SEP] + +===== sample 020 ===== +[CLS] - - and the rest of the day - - in the same period. [SEP] ready - to - boil bread, bread - to - bread and ice bread, for example, are all - in - place bread, with deulated carrots to which they add. [SEP] in the end - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -... - - - - - - - - - - - - - - - - cut the breads and into a dish. [SEP] and in the know - [SEP] + +===== sample 021 ===== +[CLS] the pakistani leader. [SEP] he said. [SEP] after the kabul government abruptly shut down the country ' s three schools, however, the problem closed july 4, 2008. [SEP] these days, that has sent a second official to the city council, which declared in august that the building was mr. ameshi ' s " district council. " [SEP] " there are not days, not days, of belief. [SEP] the number of women in england has been reduced to higher than at any time to higher education, the report said. [SEP] q : time for a 60, 50 and 50 years. [SEP] ann arbor, mich., [SEP] + +===== sample 022 ===== +[CLS], ill., with the same black vote ( 13. 7 ). [SEP] following a flight from the capital, in central africa, the aircraft will travel to london instead of flight, and then then flying to washington to london, on a first trip. [SEP] they are happy have a car, not have a dog they feel is good to offer them something. [SEP] half of the men who appeared with cuts to a range of 50m or less were described as the type - - with short build and more than vision. [SEP] 60, 80, 60, 50, 50, - - we need to get together in a minute, [SEP] + +===== sample 023 ===== +[CLS] up three areas of the country, that provided about 70 per cent of the votes for the march election. [SEP] azuz : it ' s a beautiful day - - chicago, massachusetts, etc. [SEP] the car then turned up " instinctively, " and the thief turned to the line, she said. [SEP] in jackson, ga., a co - employee was arrested days after he was injured on interstate 2. [SEP] he is unable to explain the convictions he had a week before being arrested in connection with the death of a 3 - year - old boy in 2004. [SEP] not so much flour, but butter - - flavored with [SEP] + +===== sample 024 ===== +[CLS] to a 20 - 7 run... [SEP] as a child, my days at the airport, including in london and switzerland, and my 13 days in the hospital, germany, i ' ve been cut from it and i ' m very happy to get back in touch with them. [SEP] come on, time, time, day, lots of days, come out to the end of... a period of time we have, days, they have again,, it would be a little days, in time and again, in two and a half, the staff are being left to work. [SEP] even the american coach, [SEP] + +===== sample 025 ===== +[CLS] order. [SEP] if a guy was on the ground, he would look out on the wrong road. [SEP] and everything was down, just at home to chicago ( this one ) and all the above guys would have to throw in. [SEP] i don ' t think there is a way yet, try to put the lead - off, 18, 14, 14, 1 - 14, 11, 14, 11, 14 - 10, that ' s even do it to the end of the whole season. [SEP] " it seems that we have the right thing to do, just to say,, to say, we ' ll have to [SEP] + +===== sample 026 ===== +[CLS] 74, spent the end of his half - life as a military man. [SEP] many young people to take up work - day, after - school or evening hours, or return to work for school holidays after being cut by the city government. [SEP] i wish i have had a little more time there before we heard him go, " she said. [SEP] it is one - packed, it just looks obvious, and not the end - to - end thing. [SEP] he was hit just three times in a second - round game on the road for his team in the first round of 2004 - 97. [SEP] on sunday, chicago and chicago [SEP] + +===== sample 027 ===== +[CLS] are not known. [SEP] but, yes, we can ' t be the kind of thing that we can understand, that ' s not a good thing. [SEP] if you call it a fire for such people, the physical process is something different for a us soldier. [SEP] " the shares are at a half - point, " said a trader. [SEP] and again, he ' s just right. [SEP] he added that diplomacy is the only way to get us to do what he wants. [SEP] " but short - talk is the best way to get going, " he said. [SEP] it may just be time for an eye - to [SEP] + +===== sample 028 ===== +[CLS] the house has to packed up, the owner told me yesterday, but then he has a place to cover their windows and in winter at night he can turn their lights out. [SEP] " i walked in a pretty nice way. " [SEP] the stadium, which has been synonymous with tradition since 1973, arrived in the opening round of competition for the first time at center field in chicago, in the same, the loss of the old ground to a 17th division championship. [SEP] the barclays seemed to keep showing up at all. [SEP] here in london, i make a joke, about christmas, christmas, and christmas pudding. [SEP] he was [SEP] + +===== sample 029 ===== +[CLS] too bad. [SEP] for one - - though, they won ' t be forgotten. [SEP] and the penguins are out of the playoffs - - line, line by area and point, area by area. [SEP] it was to be a great effort, and that was to get on a plane to a... on the plane, to try and end the argument. [SEP] the u. s. refused to be requests to comment. [SEP] it ' s a little weird day - to - day.... i just talked to someone beforehand on when to turn and how to get to in time. [SEP] a : we do know [SEP] + +===== sample 030 ===== +[CLS] to cool relations. [SEP] these kids have no time to get together. [SEP] by now, the government had been made to remember the word, " taking the shower, " by mr heaney, who was served as the prisoner of war. [SEP] it is a bit harder to get in the race. [SEP] finally, she did in a state of shock. [SEP] the company, meanwhile, made chairs, shoes, linens, chairs, and wipers, all, and place, a mattress manufacturer, moved from dry to dry to fresh snow. [SEP] " we went to a three - day conference - style conference on saturday, [SEP] + +===== sample 031 ===== +[CLS], blessings in the choir and, like him, a church. [SEP] there is a feeling, " they give you a lift, " he added, " in the words, in english, " red, white and white. [SEP] without it, it is not an all - american - style bread with a knife and baking flour. [SEP] the marbles were conspirated in china and argentina ( they were wooden furniture and displays of life at auschwitz during world war ii ). [SEP] he didn ' t sit and do the day ' s work and out of the bedroom, and he was on the floor. [SEP] the u. [SEP] + +===== sample 032 ===== +[CLS] to 1968, to the end of 1963, to the french point - - " oh, again. [SEP] " it seems... [SEP] even if not, " the bill will never be signed into law. [SEP] the company hopes that the figures can help to double its forecast of full - month sales since the recession began in january because of an 80 per cent increase the previous year expected. [SEP] on this day it seems so obvious he would be climbing, toe - twisting,, writing down the top, standing down to the back door, a white hat, a dog, in all, a black hat, and a dog, [SEP] + +===== sample 033 ===== +[CLS] - two weeks or a step ahead of schedule while on the ground, the house is open, along with the roof, roof, the roof and the central units. [SEP] both playwrights met with a friend, and they began to work together. [SEP] we got in travel. [SEP] but, now, the pain is greater than he had to lay his home for 10 hours. [SEP] the nets won three of in all of sept. [SEP] in chicago, he won the previous two, in chicago, then, to detroit in december. [SEP] beijing ( ap ) - - a little mask might seem to make a difference, the u. [SEP] + +===== sample 034 ===== +[CLS] have thought for now, even in the deep dark, of the story ' s glory. [SEP] of that, there are a total of 1, 000... [SEP] 1 ), at the boil, in turn, for a day, is as big as a pan of red bread, and no gas is needed. [SEP] " it ' s important that we can have a genuine resolve. [SEP] whether this is a really bad line, or not. [SEP] she even gets to sing for the new group - - ' my friends '. [SEP] however, he said, the new vote has failed to a date. [SEP] and then, [SEP] + +===== sample 035 ===== +[CLS] to help a person buy,, well, a rubber chair, or two - pack of pillows. [SEP] the panel wanted to act, just to sort it out a bit, and i decided this to be a way to keep the conversation going for years. [SEP] it was like, late into the day, you have to work hard together.... [SEP] however, he is the type to work, and he still needs to go out and get his way around. [SEP] i, up again and again, that day, afternoon and afternoon, and, after the week, the day, the day after, i went to the [SEP] + +===== sample 036 ===== +[CLS] all ages. [SEP] mr. lecce. [SEP] of course, he is wrong, but he is a joke. [SEP] i think that, a lot, has to be said, and wait, there are some options for change, so that we are having a referendum on things. [SEP] but still, look a little closer, especially in the first half, and you will be able to get down for you. [SEP] in fact, i can e - type it on the allergy in relation to the bread, butter, chit, milk, cheese, and bread - cheese. [SEP] the association also calls for councils to pay [SEP] + +===== sample 037 ===== +[CLS] ago, but that was not even a good story. [SEP] as bernanke is known, brown, brown, brown, brown, brown, brown, the rat, the dumpling, the swi, the bakek - dog, the sheep, the goats, the sheep, and the dog, the bi - racial - etc. [SEP] " we are here for day, day, night, and night. [SEP] " not one, not one - - maybe he can be a defender, " he said. [SEP] mr brown also warned he would not face difficult working conditions for the afghan police forces, even if he had [SEP] + +===== sample 038 ===== +[CLS] sort of pushed back three times in over a week but had to take his chance to drop out of the race. [SEP] " the first shot from the beginning, the one - hit, the more than 500, the jets, the nets, the celtics, and they ' re all together, " he said. [SEP] jason satter was the director of the 15 - year - old in the history of the golden states, and was a producer on the 20 - member project. [SEP] a row of students and two staff took place at the end of the school in february 2006. [SEP] a liar, " he will not have the beans [SEP] + +===== sample 039 ===== +[CLS] road. [SEP] the magic led, 38 - 17, including 15 points into the game. [SEP] the bottom line is that the day is the last week, period, and then you get out the window... [SEP] i.... trains, planes and, of course, road cars, roads, buses, trains, and trains. [SEP] government officials have said the plane had begun delivering back to the airport in 2004, but that the flight - 93 was named for the repair crew. [SEP] yeah, the fat - duck question needs to be answered and put in the... [SEP] it ' s gone on, but [SEP] + +===== sample 040 ===== +[CLS] from time to time to in..... then again, that was the tv at the time to turn to day to day - - right before the screen. [SEP] it is the moment in front of the start of a meal and by the end, just to make a basket at the end. [SEP] the other aircraft did not show up at to 1, 000 feet, or by helicopter. [SEP] he wanted to hold his breath when the news fell out, before getting off to end when he was not going to start again. [SEP] it was a black, back in 2003, a pre - season, half - in. [SEP] + +===== sample 041 ===== +[CLS], on the edge of the pool in the double - story bed, sits on a piece of deep - brown paper. [SEP] on the other side of the road some of the anti - protesters protest at the soldiers ' deaths. [SEP] and it might have had to do to the big time, non - money - - the whole thing has never stopped. [SEP] but in the end, it was usually, just once a year, but a year later, for a lot of months now, and a three years later, it will never have been again. [SEP] but for a moment we just have begun. [SEP] the 36 - year - [SEP] + +===== sample 042 ===== +[CLS] championship, and sports council officials said johnson ' s focus was beyond on four games, three - hour games, two games and a one - game - - two - week event. [SEP] it ' s 1, 000 acres, a 100, 000 - acre area. [SEP] however, for good, everything, which seems like nothing, is rubbish. [SEP] " we are already in the works to have something to go down, a lot to move in with us. [SEP] " the thought was ' yes, if they come out, " he said. [SEP] the cause of the crash, which happened a couple of hours after the road was [SEP] + +===== sample 043 ===== +[CLS], have to sell their money in a country, for free, or for the eu, or in italy. [SEP] that said it was the place to be done, and to feel, in a cold local room, we would take a few hours to try out the cheese, place and place it together on a final package, a black - white dip, half - red meats, carrots and salt, vanilla and black - pepper. [SEP] the federal government ' s new savings figure, released in february, fell sharply from the 7. 9 percent - year figure from the same period in november last year. [SEP] " at the [SEP] + +===== sample 044 ===== +[CLS] 3 days, days, days, days, 14 days..... and 4 days, 3 days, 2 days, days, 2 days, days, 3 days, 14 days, days, days, 2 days, 2 days, days, days, days, 11 days, days, days, 12 days, 4 days, days, 4 days and 4 days, days, days, back together on a normal days, and 2 hours and days in hours, days, days. [SEP] then, come the sun the sun, and then there is a little bit of sun. [SEP] that ' s a great idea to [SEP] + +===== sample 045 ===== +[CLS], according to the international monetary bank. [SEP] they said in a statement that there is a lot of evidence in their efforts to move on the issue. [SEP] it turns out that the race line is written in real knots. [SEP] today, we are in the mid - 50, 50,, 50, a year of the day. [SEP] 4, 2, 10, 15, 14, 17,, 16, 15, 21, 15, 26, 15,, 15, 16, 15, 49, 37. [SEP] in the summer of 2008, rbs reported $ 90, 000 in security costs between now and december 2000, [SEP] + +===== sample 046 ===== +[CLS] home -owners, welfare and jobs ). [SEP] it seems that the security measures are most likely to be put in place up to now. [SEP] the sense of fear surely will not gain before the minds of students return to participating in their school life. [SEP] with a little more depth,, then, then, sometimes, and sautes. [SEP] pittsburgh, panthers 2 mike danley got the second goal and five assists in a 2 - 2 victory, and mike fisher scored the first - goal early of the game to seal the win. [SEP] then, a remember... the boys come into love with me. [SEP] [SEP] + +===== sample 047 ===== +[CLS] in advance of the christmas olympics. [SEP] the bread is crisp on the outside, with the top with all the butter and juices - - to return in a small pan to the bottom. [SEP] he led his club to the conference floor when the game ended. [SEP] but, it ' s hard to imagine the americans making such a point. [SEP] the service sector and the contract are expected to reach a 16. 0 - m ( 1 ) - 3m depth at the time ( 16. 2m ). [SEP] for some of these, he just turns to, ' s ( er ), and he is.... [SEP] + +===== sample 048 ===== +[CLS],,,,,,,,,,, and the end. - - - - - down the road.. - -, well, we ' re going to get a more field day in the end, some point, maybe, and we will have to buy a real plan, but we have a better day with a better picture. [SEP] 4 ( upi ) - - toronto blue bulls, u. s. team toronto, bulls - - the bulls was back in boston for the second straight no. 1. [SEP] " the situation goes back to 1997. [SEP] so, these days, the creation of a group [SEP] + +===== sample 049 ===== +[CLS]. [SEP] if we stick to a similar conversation, then say, " that was, to be more casual, what we all wanted to do. [SEP] the course of everything, the start of the week at the end of the day, for days, and then again in year, week, after day. [SEP] at the end of september 2009, there was the increase in additional loan losses at an average value of $ 4. 8 million, up from $ 11. 9 million, in the same period of 2009. [SEP] the shares need to be sold - - or, say, a better - - sold. [SEP] 1845 : we [SEP] + +===== sample 050 ===== +[CLS] he brought down the front page is... [SEP] sevek, 13 : 10 minutes - - half, half, half, half and half - again, but it was about half - hour, half - time. [SEP] by day, day, day of the week, half - day, wake - up period, how much that time, how little is changed in. [SEP] finally, instead of a minute - just long enough to forget and take a further look at it. [SEP] instead, they are learning to put on the bed, so go to bath, in which they have access to get paid to a play. [SEP] + +===== sample 051 ===== +[CLS], 24, of leytons, was arrested. [SEP] then 65, 65, 60, 50 in the morning and then half - 52.... for the afternoon, -..., - - 50, 50, a - 60, a - 52, the celtics were 50, 60, 50, 50, and 50 - - and, after all, 50, 50 - - 50, 50, 60, 50, 50,, 52. [SEP] today, a week, 24, 40, 37, 50, 50, and time in the afternoon, for 30 to 45 seconds. [SEP] in australia, the [SEP] + +===== sample 052 ===== +[CLS] - hour, 80 - mile journey, taking nearly a year to get by. [SEP] the fall - off corruption trial took place when the court heard that a brazilian businessman had lost over 25, 000 hectares worth of land. [SEP] all his work, the wooden structure - - based on long, period structure - - became the story of the installation. [SEP] easttown, s. s. vancouver, sept. [SEP] while he ' s just for christmas - - the end of the christmas season - - his son, chris, has had a decent campaign this week - - perhaps. [SEP] 4 ( upi ) - - u. s [SEP] + +===== sample 053 ===== +[CLS] typically trade in at 90 % - 40 % in current market prices, and do not rise until further in the winter. [SEP] put out of the juices, cut in a large saucepan, and season the butter and ice at half - hour time. [SEP] and the same thing could have happened.... [SEP] in a bowl, place for a close and reduce to half - size flour, bring in a place, so that is a more satisfying choice for the whole family. [SEP] ian wexer, a researcher with the medical office, examined the children in one of their studies. [SEP] the move came to months in [SEP] + +===== sample 054 ===== +[CLS]. [SEP] yes, " white house spokesman gordon young said. [SEP] so clearly, for after days, the perfect time to go, to take the trail back to, after dark, back in the dark place. [SEP] he tells us, and, then, then, why not only is he mean, really, but also he, he said, he is. [SEP] a pan of coconut butter hung on the right side of a rice, thin - scented baking machine. [SEP] unfortunately, america is unable to stand the balance again ( and then again, of course,, again, again and again ) on the line to the original and [SEP] + +===== sample 055 ===== +[CLS]. [SEP] 2. 6bn ) to multi - year investment gains made in the last three years, up to 0. 6 per cent year - on - year, year - to - year - to - date up from 4. 7 per cent in 1998 - 07. [SEP] " business travel is driven by entrepreneurship, " she said. [SEP] i ' ve had to say everything, and we ' ve got to talk. [SEP] however, according to his brother david, who led the investigation, " he was able to go back.. [SEP] and then again, then, now, now and again. [SEP] " if i could get [SEP] + +===== sample 056 ===== +[CLS] in traditional schools. [SEP] shoes are often visible - - and largees of shoes, blankets, harnesses and linens are just to follow. [SEP] " we took some of the essence of the show ' s character from time to time to time, " he says. [SEP] if you want to act, let us laugh, feel, talk, think - - eat, to get home and a bit of sleep. [SEP] today, here he was by side, in the back - room, in a short, quiet place in the middle of night, and in the centre of the evening, he can be, for days, a [SEP] + +===== sample 057 ===== +[CLS] period, and the time to,,,,,,,, starting with a week,,, no one,,,,,... and, then, again, the rest is enough to do everything again... [SEP] it is very bad and wants to do it more efficiently. [SEP] the work of dr. spitz, a mathematician, who jumps and writes,,,,,, days in the back of a plane, takes for a lot of days for the beginning, then, sometimes, then,, to come up with check - in beginning, then set up on a path in the end [SEP] + +===== sample 058 ===== +[CLS] s way of things, which is his own goal. [SEP] it is a great indeed. [SEP] the good thing is, remember, if a coach is get out of the deal, but he has hit over the top of it in the deal, that he makes the deal again, on the plane, on dhl today. [SEP] 2007 - - - - - - - - - - - - - - - - - - as of december 31, 2007, 31 - 2007 - 13, 0230 - £29, 000 - £175, 000, in 2008 - 31, 000 - 300. the actual number 501 ( 1 [SEP] + +===== sample 059 ===== +[CLS] 2010, it is clear. [SEP] however, the end of 2006 was a first step. [SEP] and there is more to come to make of, and very few excuses. [SEP] in fact, the crowd roared and then finally brought it to a halt, quickly turning the show into again. [SEP] the producers realize, however, that works like pillows and rinses are just examples of a child stopper ' s passion for child care. [SEP] " in the face of this road, i urge you to read this constitution, to make sure to be better, working, to get better and stay better, " said the u. s [SEP] + +===== sample 060 ===== +[CLS] health care. [SEP] i sat in the office for a minute of a single day, when he wanted to look me in the mirror, and got the answer. [SEP] the man who wrote, and spoke in italian, a fake and a fake, was photographed with the minister ' s apron, and the answer was written in white. [SEP] the forecast is expected to bring to 10 - 15, 000 tonnes of power capacity in the second quarter. [SEP] that means a top aide revenue rate of an additional 11 percent. [SEP] los angeles - the celtics have stumbled to a first victory in a playoff game, the first coming at the end of [SEP] + +===== sample 061 ===== +[CLS] stories and poetry, and so there are people to find historical and useful items from history. [SEP] in addition, the national civil ' union, john kelly, wanted to make a comment on the deal in return so that companies would not be able to fund large " post - contract " - related work. [SEP] he told bbc news " one of a number of members at the wirral trust has been campaigning in favour of extending the line service. [SEP] i know, that is incredible. [SEP] so - - well, it would be that he has to " reckoned with respect " and the rest has to stop. [SEP] but then, [SEP] + +===== sample 062 ===== +[CLS] well as the nation, " he said. [SEP] the day ' s event was a two - hour period as it turned into a start - off. [SEP] then a - 4,, 5, 5, 5, and - - on a 10 - yard,, 11, 13, 100 - yard, and yard rally from a 10 - point, 11, for - 10 news conference. [SEP] it is a change of direction. [SEP] the majority of the bank ' s assets are in commercial mortgage - backed commercial securities, with most assets in relation to mortgage - backed securities, including fixed - income and other junior mortgages. [SEP] [SEP] + +===== sample 063 ===== +[CLS] $ 15 billion, down earnings a share in the first quarter. [SEP] i was not sure to look at, anywhere in his face - and then, and gone along with his way to talk about the job. [SEP] he just seems not to believe it ' s true. [SEP] so why do they want me to take the other children to their school and to the house and i ' d have to watch the same thing again. [SEP] a police spokesman said : " this is an incredible mix of dark, orange, and blue, and like. [SEP] i feel like, i wonder why the council might want to turn it into a less [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/state_c256_t1p45_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/state_c256_t1p45_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..3b4115288278e2bd7949b82dd7bf23644011e15f --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/state_c256_t1p45_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "state_c256_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c256_t1p45", "steps": 32, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 44.930859242990756, "nll_per_token": 3.8051248469363923, "tokens": 9366}, "diversity": {"sample_entropy": 3.7823763722555808, "unique_tokens": 1422, "token_count": 8192, "distinct_1": 0.173583984375, "distinct_2": 0.5745570866141733, "top_token_mass": 0.11572265625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] season, high - season games, it was so good that a lot of them make that impact. [SEP] there is also a little warmth to the young wife, michelle ( who is attached to the story, but to the novel, not all of it, too ). [SEP] \" there will be times when you know you have to put your hat on to you. [SEP] \" sometimes we just get off to get around, \" he said. [SEP] he did not even let himself in on the side of the court building. [SEP] he finished the night of full - court drama. [SEP] the project, called the development of the research to [SEP]", "detok_text": "[CLS] season, high - season games, it was so good that a lot of them make that impact. [SEP] there is also a little warmth to the young wife, michelle (who is attached to the story, but to the novel, not all of it, too). [SEP] \"there will be times when you know you have to put your hat on to you. [SEP]\" sometimes we just get off to get around, \" he said. [SEP] he did not even let himself in on the side of the court building. [SEP] he finished the night of full - court drama. [SEP] the project, called the development of the research to [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] in his room, however, maybe in 1962 - - maybe once a week in 1981. [SEP] and the knicks ' trip of the season, back to cleveland, back to the new stadium. [SEP] if it ' s the perfect time, mix the eggs, add, finally, the flour, and turn over the panes of the flour. [SEP] \" i have to go for it, \" ronaldo said. [SEP] \" the government was really prepared to do it. [SEP] this is a new approach. [SEP] however, the man, known as mr colla ' s lawyer, was unable to make a court statement. [SEP] that ' [SEP]", "detok_text": "[CLS] in his room, however, maybe in 1962 - - maybe once a week in 1981. [SEP] and the knicks' trip of the season, back to cleveland, back to the new stadium. [SEP] if it's the perfect time, mix the eggs, add, finally, the flour, and turn over the panes of the flour. [SEP] \"i have to go for it,\" ronaldo said. [SEP] \" the government was really prepared to do it. [SEP] this is a new approach. [SEP] however, the man, known as mr colla's lawyer, was unable to make a court statement. [SEP] that ' [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] said. [SEP] to do that, there ' s all the difference. [SEP] at least a half - - some 60 - - are priced at around £1, 000. [SEP] at the start of the show, the performers turned the main arena into a small, box - and - room full of music, love, and bits of a rock star. [SEP] the conservatives, who raised £5. 6m in the past year, said the election result was \" unfair. \" [SEP] since then they are required to admit in their consent that one reflects on them while sitting in the same house. [SEP] ap reporters contributed from gaza. [SEP] meanwhile, [SEP]", "detok_text": "[CLS] said. [SEP] to do that, there's all the difference. [SEP] at least a half - - some 60 - - are priced at around £1, 000. [SEP] at the start of the show, the performers turned the main arena into a small, box - and - room full of music, love, and bits of a rock star. [SEP] the conservatives, who raised £5. 6m in the past year, said the election result was \"unfair.\" [SEP] since then they are required to admit in their consent that one reflects on them while sitting in the same house. [SEP] ap reporters contributed from gaza. [SEP] meanwhile, [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS] of the current crisis. [SEP] there is such thing as a mask, a mask, a... \" [SEP] at the height of that period, he managed to escape when he was, in fact, known as the bank of england in ireland. [SEP] add together, add bread, bread, butter, the eggs, bacon, the juices, and cheese. [SEP] in a process that takes back to, say, to,, to, to see, the location, not the time, a place where things is going on often, the day is, the is, and the day with an air. [SEP] he would have [SEP]", "detok_text": "[CLS] of the current crisis. [SEP] there is such thing as a mask, a mask, a... \" [SEP] at the height of that period, he managed to escape when he was, in fact, known as the bank of england in ireland. [SEP] add together, add bread, bread, butter, the eggs, bacon, the juices, and cheese. [SEP] in a process that takes back to, say, to,, to, to see, the location, not the time, a place where things is going on often, the day is, the is, and the day with an air. [SEP] he would have [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] 0830 gmt. [SEP] \" we have a lot of time in looking for a new plan, but we have not gone with it with our plan, and we look up with, \" he said. [SEP] the answer, trying to turn out what it is, often comes on a long day. [SEP] he ' s had a all - star all - star season break. [SEP] the rest of the day,,,,,,,,,,,,,,,,,,,, i have seen, and said, what it is, opportunity to come, explain, and come and believe it. [SEP] he [SEP]", "detok_text": "[CLS] 0830 gmt. [SEP] \"we have a lot of time in looking for a new plan, but we have not gone with it with our plan, and we look up with,\" he said. [SEP] the answer, trying to turn out what it is, often comes on a long day. [SEP] he's had a all - star all - star season break. [SEP] the rest of the day,,,,,,,,,,,,,,,,,,,, i have seen, and said, what it is, opportunity to come, explain, and come and believe it. [SEP] he [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] s caffeine, stuck in london, and sat around waiting for several months to move off, before landing in the open in new york and landing, again, in new york with chris stewart and pat williams. [SEP] \" if they ' re going to negotiate, they say ' vote for you, ' \" said wright, on the subject of an interview. [SEP] the center ' s annual sell - out to a street is for thursday. [SEP] after all, the absence of money from football is significant. [SEP] in some sense, that place has built up a bit of a small space that, a little, of course, a [SEP]", "detok_text": "[CLS] s caffeine, stuck in london, and sat around waiting for several months to move off, before landing in the open in new york and landing, again, in new york with chris stewart and pat williams. [SEP] \"if they're going to negotiate, they say'vote for you,'\" said wright, on the subject of an interview. [SEP] the center's annual sell - out to a street is for thursday. [SEP] after all, the absence of money from football is significant. [SEP] in some sense, that place has built up a bit of a small space that, a little, of course, a [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] over the course of the grind, add the diagonal side, then, in the time, to the horizontal side, begin to. - break a pattern, slice the pastry in a small, again. - - again, again at a 15 - point point, half, half,, half, for a different kind of pattern. - then, as the heel, back in turn, again in the back, to top the line in time. - - the foot ' s turn to turn, line, turn to, out of shape. [SEP] the answer. [SEP] when i take off it seems to take off again, to the [SEP]", "detok_text": "[CLS] over the course of the grind, add the diagonal side, then, in the time, to the horizontal side, begin to. - break a pattern, slice the pastry in a small, again. - - again, again at a 15 - point point, half, half,, half, for a different kind of pattern. - then, as the heel, back in turn, again in the back, to top the line in time. - - the foot's turn to turn, line, turn to, out of shape. [SEP] the answer. [SEP] when i take off it seems to take off again, to the [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] losses. [SEP] and they have to remember that their mission was not to invent words but to invent them. [SEP] granted, i see - in, week,, week, there was the only day, in the event of change, of \", for nothing, \" of \" year, for day at work \" and in the game of rest - - well, a good day. [SEP] in fact, the road has to do and the road has to work, but it is not there. [SEP] 7, anaheim 0 ( 18 - 16 - 30 saves ). [SEP] canada, brazil, brazil, thailand, turkey, thailand [SEP]", "detok_text": "[CLS] losses. [SEP] and they have to remember that their mission was not to invent words but to invent them. [SEP] granted, i see - in, week,, week, there was the only day, in the event of change, of \", for nothing, \"of\" year, for day at work \" and in the game of rest - - well, a good day. [SEP] in fact, the road has to do and the road has to work, but it is not there. [SEP] 7, anaheim 0 (18 - 16 - 30 saves). [SEP] canada, brazil, brazil, thailand, turkey, thailand [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] black - headed nabullah khan, a hot - voiced jewish figure who loves one ' s way of life, are lonely, unable to reveal, literally, brilliantly,, almost sulkly. [SEP] now, the teams have spent years of working out the differences. [SEP] the service includes weeks of driving in one direction, perhaps for the first time, and on - and drive - in between hours. [SEP] weaver, who hit a two - run rbi homer and an rbi homer, closed to a perfect 10 for the first time since. [SEP] it ' s because the democrats are just a drain on democracy, and it is [SEP]", "detok_text": "[CLS] black - headed nabullah khan, a hot - voiced jewish figure who loves one's way of life, are lonely, unable to reveal, literally, brilliantly,, almost sulkly. [SEP] now, the teams have spent years of working out the differences. [SEP] the service includes weeks of driving in one direction, perhaps for the first time, and on - and drive - in between hours. [SEP] weaver, who hit a two - run rbi homer and an rbi homer, closed to a perfect 10 for the first time since. [SEP] it's because the democrats are just a drain on democracy, and it is [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] bill that went back - to - back investigations in 2004. [SEP] i wonder if they will do the same this time. [SEP] we have in days, days, then days, weeks and back in the air. [SEP] it ' s a forced - to - go back - to - back, you have a good idea. [SEP] now, the magic has gone out of fashion, - - - - - - - - - - - - - - - - - - - - - - - - - for a quarter - and - half - and - a - half -, the whole end of the whole, 2008, a little [SEP]", "detok_text": "[CLS] bill that went back - to - back investigations in 2004. [SEP] i wonder if they will do the same this time. [SEP] we have in days, days, then days, weeks and back in the air. [SEP] it's a forced - to - go back - to - back, you have a good idea. [SEP] now, the magic has gone out of fashion, - - - - - - - - - - - - - - - - - - - - - - - - - for a quarter - and - half - and - a - half -, the whole end of the whole, 2008, a little [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] day, brings to mark the record of the 16 - year - old order. [SEP] he is likely to have gone to the moon in space. [SEP] mr brown said the us would not talk until the vote - counting was made in january. [SEP] the man ' s son ' s wife who lived in the city centre has moved up on a trip to chicago, and his family is home in east heath, ma. [SEP] that, after two 14 - game losses to the celtics ' nemesis, the pistons and the washington bulls, resulted in a seven - game series, not three games. [SEP] the network ' s chief fire officer, [SEP]", "detok_text": "[CLS] day, brings to mark the record of the 16 - year - old order. [SEP] he is likely to have gone to the moon in space. [SEP] mr brown said the us would not talk until the vote - counting was made in january. [SEP] the man's son's wife who lived in the city centre has moved up on a trip to chicago, and his family is home in east heath, ma. [SEP] that, after two 14 - game losses to the celtics' nemesis, the pistons and the washington bulls, resulted in a seven - game series, not three games. [SEP] the network's chief fire officer, [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] said it was making the decision to suspend operations. [SEP] it has to change... and it ' s just a day - by - day - by - day for your people to vote... ( \" is over \" ).. [SEP] add the breads, then green, then, pre - season, bring over the butter with a small plate, then make a mix - - stirring, place in the oven, then until, stirring. [SEP] hill, who lost his right job monday, is on the road trip to his nemesis, the white sox. [SEP] \" i ' m sure everyone knows it. [SEP] his [SEP]", "detok_text": "[CLS] said it was making the decision to suspend operations. [SEP] it has to change... and it's just a day - by - day - by - day for your people to vote... (\"is over\").. [SEP] add the breads, then green, then, pre - season, bring over the butter with a small plate, then make a mix - - stirring, place in the oven, then until, stirring. [SEP] hill, who lost his right job monday, is on the road trip to his nemesis, the white sox. [SEP] \" i'm sure everyone knows it. [SEP] his [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], can provide that kind of protection. [SEP] a slice - and - paste bag of paper was used to support the cabinet. [SEP] in fact, the ensuing bust - up led to the battle. [SEP] the journey of the island is not easy. [SEP] mix in a mixture of garlic, chilied, zeal, juice, black flour, red onion, cinnamon, garlic, cred, sugar - flour, tomato, tomato, and garlic, all of all in the water. [SEP] bring to the boil - - cover with the brown flour. [SEP] they do have the ability to sort the crap out of the system. [SEP] \" [SEP]", "detok_text": "[CLS], can provide that kind of protection. [SEP] a slice - and - paste bag of paper was used to support the cabinet. [SEP] in fact, the ensuing bust - up led to the battle. [SEP] the journey of the island is not easy. [SEP] mix in a mixture of garlic, chilied, zeal, juice, black flour, red onion, cinnamon, garlic, cred, sugar - flour, tomato, tomato, and garlic, all of all in the water. [SEP] bring to the boil - - cover with the brown flour. [SEP] they do have the ability to sort the crap out of the system. [SEP] \" [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS] a lot of the journey to the idea of the most famous place, days, days.... and well, you would have to stop the place. [SEP] it is no longer clear that she was never dressed in the way it must have been at all before her. [SEP] it was at boston, detroit, cleveland - - - - - - - detroit, cleveland, chicago, miami, cleveland, the final days of the road game, boston - chicago, boston - - - in new york, chicago, chicago. [SEP] bobcats 100, denver 100 : james wallace had 16 points and 10 rebounds. [SEP] for example, [SEP]", "detok_text": "[CLS] a lot of the journey to the idea of the most famous place, days, days.... and well, you would have to stop the place. [SEP] it is no longer clear that she was never dressed in the way it must have been at all before her. [SEP] it was at boston, detroit, cleveland - - - - - - - detroit, cleveland, chicago, miami, cleveland, the final days of the road game, boston - chicago, boston - - - in new york, chicago, chicago. [SEP] bobcats 100, denver 100: james wallace had 16 points and 10 rebounds. [SEP] for example, [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] in black, with the long eyes. [SEP] just place, in, together, on the tray, then grind - in place, place on the top, and back on the thin side. [SEP] sometimes, just sometimes - - just in the air, sometimes - - sometimes, just in the office, not ice, but i think i understand that you have to get back to the weekend,,,, back - then... and about 90 percent of that.... [SEP] the main line, which started friday, is a short - line of 2, 000 feet, the size of 1, 000 meters ( 2 [SEP]", "detok_text": "[CLS] in black, with the long eyes. [SEP] just place, in, together, on the tray, then grind - in place, place on the top, and back on the thin side. [SEP] sometimes, just sometimes - - just in the air, sometimes - - sometimes, just in the office, not ice, but i think i understand that you have to get back to the weekend,,,, back - then... and about 90 percent of that.... [SEP] the main line, which started friday, is a short - line of 2, 000 feet, the size of 1, 000 meters ( 2 [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS] [SEP] brown, 17 years old, has admitted to the court to the charges, but has not responded to any charges. [SEP] monday, september 26, 2008, october 31, 2008. [SEP] \" we will have to plant 10, 000 vehicles by the end of 2011, to be taken into production, \" he added, referring to projects in the east.. [SEP] the black and powdered buses rolled along the roads in china ' s capital, many of the trucks, and dozens of bridges, at the facades of government buildings. [SEP] \" i have a crush, i need a vomit, \" his father said. [SEP] he, [SEP]", "detok_text": "[CLS] [SEP] brown, 17 years old, has admitted to the court to the charges, but has not responded to any charges. [SEP] monday, september 26, 2008, october 31, 2008. [SEP] \"we will have to plant 10, 000 vehicles by the end of 2011, to be taken into production,\" he added, referring to projects in the east.. [SEP] the black and powdered buses rolled along the roads in china's capital, many of the trucks, and dozens of bridges, at the facades of government buildings. [SEP] \"i have a crush, i need a vomit,\" his father said. [SEP] he, [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS]. [SEP] i can ' t blame it to have to wait to tell people who all do. [SEP] the green clouds looked ominously over the tree, while the buildings moved from the first step toward their descent to trees. [SEP] i do want to know if you have an idea. [SEP] from the beginning, jim bradley ' s coffin, pinned to the name of willie walsh, was, if visible. [SEP] 1, for days 1, 1, 2003,, and 2008. [SEP] the 12 - week period was tendered for just two days and, for the first time, eight days, all due to the disruption, the commission [SEP]", "detok_text": "[CLS]. [SEP] i can't blame it to have to wait to tell people who all do. [SEP] the green clouds looked ominously over the tree, while the buildings moved from the first step toward their descent to trees. [SEP] i do want to know if you have an idea. [SEP] from the beginning, jim bradley's coffin, pinned to the name of willie walsh, was, if visible. [SEP] 1, for days 1, 1, 2003,, and 2008. [SEP] the 12 - week period was tendered for just two days and, for the first time, eight days, all due to the disruption, the commission [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] way, she ' s going to raise her head again, before going to pay attention that some of her best friends are going to make a try for you - - just to make it. [SEP] the stock market goes back a week after week, the reserve bank of chicago, week - week, week - week - - - - month. [SEP] weeks and days, i have walked back, again, to sleep. [SEP] the planes, planes,,, planes,,,,,,, the planes,,,,,,,,,,,, etc. [SEP] if you are on an unusual vacation, you can [SEP]", "detok_text": "[CLS] way, she's going to raise her head again, before going to pay attention that some of her best friends are going to make a try for you - - just to make it. [SEP] the stock market goes back a week after week, the reserve bank of chicago, week - week, week - week - - - - month. [SEP] weeks and days, i have walked back, again, to sleep. [SEP] the planes, planes,,, planes,,,,,,, the planes,,,,,,,,,,,, etc. [SEP] if you are on an unusual vacation, you can [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS]daq. cash & e decreased by 4. 14 % to 4. 40 per share. $ 1, 3663 million, with cash flow charge continuing back to 65 %. balance by 2q0 _ 2009 - - c -0, the energy department. report. [SEP] pieces, including the skeletons, were separated into the remains of the plane, a line on the ground, half, half - - half, more than a half - minute longer than normal. [SEP] peanuts, f - 16s, crams, dunk, gap, bla, and paper - - - just a piece of weight, [SEP]", "detok_text": "[CLS]daq. cash & e decreased by 4. 14 % to 4. 40 per share. $1, 3663 million, with cash flow charge continuing back to 65 %. balance by 2q0 _ 2009 - - c -0, the energy department. report. [SEP] pieces, including the skeletons, were separated into the remains of the plane, a line on the ground, half, half - - half, more than a half - minute longer than normal. [SEP] peanuts, f - 16s, crams, dunk, gap, bla, and paper - - - just a piece of weight, [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] report. [SEP] the colors of 70, 50 - 76, 80, 70 - 70, and other colors were noted for black, black, 60 - in, 50 - in, 60 - in, 60 - in -, 60 -, 60 -,, 60 -, -, 50 -, 50 -,, 60 -,, 50 -,, etc. [SEP] the magic led, 15 - 14, as the favorite to change cleveland ' s schedule. [SEP] what is said, to come, to write, to speak, is nothing,, not, nothing. [SEP] he also told potential investors that hefty profits [SEP]", "detok_text": "[CLS] report. [SEP] the colors of 70, 50 - 76, 80, 70 - 70, and other colors were noted for black, black, 60 - in, 50 - in, 60 - in, 60 - in -, 60 -, 60 -,, 60 -, -, 50 -, 50 -,, 60 -,, 50 -,, etc. [SEP] the magic led, 15 - 14, as the favorite to change cleveland's schedule. [SEP] what is said, to come, to write, to speak, is nothing,, not, nothing. [SEP] he also told potential investors that hefty profits [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] - - and the rest of the day - - in the same period. [SEP] ready - to - boil bread, bread - to - bread and ice bread, for example, are all - in - place bread, with deulated carrots to which they add. [SEP] in the end - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -... - - - - - - - - - - - - - - - - cut the breads and into a dish. [SEP] and in the know - [SEP]", "detok_text": "[CLS] - - and the rest of the day - - in the same period. [SEP] ready - to - boil bread, bread - to - bread and ice bread, for example, are all - in - place bread, with deulated carrots to which they add. [SEP] in the end - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -... - - - - - - - - - - - - - - - - cut the breads and into a dish. [SEP] and in the know - [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] the pakistani leader. [SEP] he said. [SEP] after the kabul government abruptly shut down the country ' s three schools, however, the problem closed july 4, 2008. [SEP] these days, that has sent a second official to the city council, which declared in august that the building was mr. ameshi ' s \" district council. \" [SEP] \" there are not days, not days, of belief. [SEP] the number of women in england has been reduced to higher than at any time to higher education, the report said. [SEP] q : time for a 60, 50 and 50 years. [SEP] ann arbor, mich., [SEP]", "detok_text": "[CLS] the pakistani leader. [SEP] he said. [SEP] after the kabul government abruptly shut down the country's three schools, however, the problem closed july 4, 2008. [SEP] these days, that has sent a second official to the city council, which declared in august that the building was mr. ameshi's \"district council.\" [SEP] \" there are not days, not days, of belief. [SEP] the number of women in england has been reduced to higher than at any time to higher education, the report said. [SEP] q: time for a 60, 50 and 50 years. [SEP] ann arbor, mich., [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS], ill., with the same black vote ( 13. 7 ). [SEP] following a flight from the capital, in central africa, the aircraft will travel to london instead of flight, and then then flying to washington to london, on a first trip. [SEP] they are happy have a car, not have a dog they feel is good to offer them something. [SEP] half of the men who appeared with cuts to a range of 50m or less were described as the type - - with short build and more than vision. [SEP] 60, 80, 60, 50, 50, - - we need to get together in a minute, [SEP]", "detok_text": "[CLS], ill., with the same black vote (13. 7). [SEP] following a flight from the capital, in central africa, the aircraft will travel to london instead of flight, and then then flying to washington to london, on a first trip. [SEP] they are happy have a car, not have a dog they feel is good to offer them something. [SEP] half of the men who appeared with cuts to a range of 50m or less were described as the type - - with short build and more than vision. [SEP] 60, 80, 60, 50, 50, - - we need to get together in a minute, [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS] up three areas of the country, that provided about 70 per cent of the votes for the march election. [SEP] azuz : it ' s a beautiful day - - chicago, massachusetts, etc. [SEP] the car then turned up \" instinctively, \" and the thief turned to the line, she said. [SEP] in jackson, ga., a co - employee was arrested days after he was injured on interstate 2. [SEP] he is unable to explain the convictions he had a week before being arrested in connection with the death of a 3 - year - old boy in 2004. [SEP] not so much flour, but butter - - flavored with [SEP]", "detok_text": "[CLS] up three areas of the country, that provided about 70 per cent of the votes for the march election. [SEP] azuz: it's a beautiful day - - chicago, massachusetts, etc. [SEP] the car then turned up \"instinctively,\" and the thief turned to the line, she said. [SEP] in jackson, ga., a co - employee was arrested days after he was injured on interstate 2. [SEP] he is unable to explain the convictions he had a week before being arrested in connection with the death of a 3 - year - old boy in 2004. [SEP] not so much flour, but butter - - flavored with [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] to a 20 - 7 run... [SEP] as a child, my days at the airport, including in london and switzerland, and my 13 days in the hospital, germany, i ' ve been cut from it and i ' m very happy to get back in touch with them. [SEP] come on, time, time, day, lots of days, come out to the end of... a period of time we have, days, they have again,, it would be a little days, in time and again, in two and a half, the staff are being left to work. [SEP] even the american coach, [SEP]", "detok_text": "[CLS] to a 20 - 7 run... [SEP] as a child, my days at the airport, including in london and switzerland, and my 13 days in the hospital, germany, i've been cut from it and i'm very happy to get back in touch with them. [SEP] come on, time, time, day, lots of days, come out to the end of... a period of time we have, days, they have again,, it would be a little days, in time and again, in two and a half, the staff are being left to work. [SEP] even the american coach, [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] order. [SEP] if a guy was on the ground, he would look out on the wrong road. [SEP] and everything was down, just at home to chicago ( this one ) and all the above guys would have to throw in. [SEP] i don ' t think there is a way yet, try to put the lead - off, 18, 14, 14, 1 - 14, 11, 14, 11, 14 - 10, that ' s even do it to the end of the whole season. [SEP] \" it seems that we have the right thing to do, just to say,, to say, we ' ll have to [SEP]", "detok_text": "[CLS] order. [SEP] if a guy was on the ground, he would look out on the wrong road. [SEP] and everything was down, just at home to chicago (this one) and all the above guys would have to throw in. [SEP] i don't think there is a way yet, try to put the lead - off, 18, 14, 14, 1 - 14, 11, 14, 11, 14 - 10, that's even do it to the end of the whole season. [SEP] \" it seems that we have the right thing to do, just to say,, to say, we'll have to [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] 74, spent the end of his half - life as a military man. [SEP] many young people to take up work - day, after - school or evening hours, or return to work for school holidays after being cut by the city government. [SEP] i wish i have had a little more time there before we heard him go, \" she said. [SEP] it is one - packed, it just looks obvious, and not the end - to - end thing. [SEP] he was hit just three times in a second - round game on the road for his team in the first round of 2004 - 97. [SEP] on sunday, chicago and chicago [SEP]", "detok_text": "[CLS] 74, spent the end of his half - life as a military man. [SEP] many young people to take up work - day, after - school or evening hours, or return to work for school holidays after being cut by the city government. [SEP] i wish i have had a little more time there before we heard him go, \" she said. [SEP] it is one - packed, it just looks obvious, and not the end - to - end thing. [SEP] he was hit just three times in a second - round game on the road for his team in the first round of 2004 - 97. [SEP] on sunday, chicago and chicago [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS] are not known. [SEP] but, yes, we can ' t be the kind of thing that we can understand, that ' s not a good thing. [SEP] if you call it a fire for such people, the physical process is something different for a us soldier. [SEP] \" the shares are at a half - point, \" said a trader. [SEP] and again, he ' s just right. [SEP] he added that diplomacy is the only way to get us to do what he wants. [SEP] \" but short - talk is the best way to get going, \" he said. [SEP] it may just be time for an eye - to [SEP]", "detok_text": "[CLS] are not known. [SEP] but, yes, we can't be the kind of thing that we can understand, that's not a good thing. [SEP] if you call it a fire for such people, the physical process is something different for a us soldier. [SEP] \"the shares are at a half - point,\" said a trader. [SEP] and again, he's just right. [SEP] he added that diplomacy is the only way to get us to do what he wants. [SEP] \"but short - talk is the best way to get going,\" he said. [SEP] it may just be time for an eye - to [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] the house has to packed up, the owner told me yesterday, but then he has a place to cover their windows and in winter at night he can turn their lights out. [SEP] \" i walked in a pretty nice way. \" [SEP] the stadium, which has been synonymous with tradition since 1973, arrived in the opening round of competition for the first time at center field in chicago, in the same, the loss of the old ground to a 17th division championship. [SEP] the barclays seemed to keep showing up at all. [SEP] here in london, i make a joke, about christmas, christmas, and christmas pudding. [SEP] he was [SEP]", "detok_text": "[CLS] the house has to packed up, the owner told me yesterday, but then he has a place to cover their windows and in winter at night he can turn their lights out. [SEP] \"i walked in a pretty nice way.\" [SEP] the stadium, which has been synonymous with tradition since 1973, arrived in the opening round of competition for the first time at center field in chicago, in the same, the loss of the old ground to a 17th division championship. [SEP] the barclays seemed to keep showing up at all. [SEP] here in london, i make a joke, about christmas, christmas, and christmas pudding. [SEP] he was [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] too bad. [SEP] for one - - though, they won ' t be forgotten. [SEP] and the penguins are out of the playoffs - - line, line by area and point, area by area. [SEP] it was to be a great effort, and that was to get on a plane to a... on the plane, to try and end the argument. [SEP] the u. s. refused to be requests to comment. [SEP] it ' s a little weird day - to - day.... i just talked to someone beforehand on when to turn and how to get to in time. [SEP] a : we do know [SEP]", "detok_text": "[CLS] too bad. [SEP] for one - - though, they won't be forgotten. [SEP] and the penguins are out of the playoffs - - line, line by area and point, area by area. [SEP] it was to be a great effort, and that was to get on a plane to a... on the plane, to try and end the argument. [SEP] the u. s. refused to be requests to comment. [SEP] it's a little weird day - to - day.... i just talked to someone beforehand on when to turn and how to get to in time. [SEP] a: we do know [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] to cool relations. [SEP] these kids have no time to get together. [SEP] by now, the government had been made to remember the word, \" taking the shower, \" by mr heaney, who was served as the prisoner of war. [SEP] it is a bit harder to get in the race. [SEP] finally, she did in a state of shock. [SEP] the company, meanwhile, made chairs, shoes, linens, chairs, and wipers, all, and place, a mattress manufacturer, moved from dry to dry to fresh snow. [SEP] \" we went to a three - day conference - style conference on saturday, [SEP]", "detok_text": "[CLS] to cool relations. [SEP] these kids have no time to get together. [SEP] by now, the government had been made to remember the word, \"taking the shower,\" by mr heaney, who was served as the prisoner of war. [SEP] it is a bit harder to get in the race. [SEP] finally, she did in a state of shock. [SEP] the company, meanwhile, made chairs, shoes, linens, chairs, and wipers, all, and place, a mattress manufacturer, moved from dry to dry to fresh snow. [SEP] \" we went to a three - day conference - style conference on saturday, [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS], blessings in the choir and, like him, a church. [SEP] there is a feeling, \" they give you a lift, \" he added, \" in the words, in english, \" red, white and white. [SEP] without it, it is not an all - american - style bread with a knife and baking flour. [SEP] the marbles were conspirated in china and argentina ( they were wooden furniture and displays of life at auschwitz during world war ii ). [SEP] he didn ' t sit and do the day ' s work and out of the bedroom, and he was on the floor. [SEP] the u. [SEP]", "detok_text": "[CLS], blessings in the choir and, like him, a church. [SEP] there is a feeling, \"they give you a lift,\" he added, \"in the words, in english,\" red, white and white. [SEP] without it, it is not an all - american - style bread with a knife and baking flour. [SEP] the marbles were conspirated in china and argentina (they were wooden furniture and displays of life at auschwitz during world war ii). [SEP] he didn't sit and do the day's work and out of the bedroom, and he was on the floor. [SEP] the u. [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] to 1968, to the end of 1963, to the french point - - \" oh, again. [SEP] \" it seems... [SEP] even if not, \" the bill will never be signed into law. [SEP] the company hopes that the figures can help to double its forecast of full - month sales since the recession began in january because of an 80 per cent increase the previous year expected. [SEP] on this day it seems so obvious he would be climbing, toe - twisting,, writing down the top, standing down to the back door, a white hat, a dog, in all, a black hat, and a dog, [SEP]", "detok_text": "[CLS] to 1968, to the end of 1963, to the french point - - \"oh, again. [SEP]\" it seems... [SEP] even if not, \" the bill will never be signed into law. [SEP] the company hopes that the figures can help to double its forecast of full - month sales since the recession began in january because of an 80 per cent increase the previous year expected. [SEP] on this day it seems so obvious he would be climbing, toe - twisting,, writing down the top, standing down to the back door, a white hat, a dog, in all, a black hat, and a dog, [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS] - two weeks or a step ahead of schedule while on the ground, the house is open, along with the roof, roof, the roof and the central units. [SEP] both playwrights met with a friend, and they began to work together. [SEP] we got in travel. [SEP] but, now, the pain is greater than he had to lay his home for 10 hours. [SEP] the nets won three of in all of sept. [SEP] in chicago, he won the previous two, in chicago, then, to detroit in december. [SEP] beijing ( ap ) - - a little mask might seem to make a difference, the u. [SEP]", "detok_text": "[CLS] - two weeks or a step ahead of schedule while on the ground, the house is open, along with the roof, roof, the roof and the central units. [SEP] both playwrights met with a friend, and they began to work together. [SEP] we got in travel. [SEP] but, now, the pain is greater than he had to lay his home for 10 hours. [SEP] the nets won three of in all of sept. [SEP] in chicago, he won the previous two, in chicago, then, to detroit in december. [SEP] beijing (ap) - - a little mask might seem to make a difference, the u. [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] have thought for now, even in the deep dark, of the story ' s glory. [SEP] of that, there are a total of 1, 000... [SEP] 1 ), at the boil, in turn, for a day, is as big as a pan of red bread, and no gas is needed. [SEP] \" it ' s important that we can have a genuine resolve. [SEP] whether this is a really bad line, or not. [SEP] she even gets to sing for the new group - - ' my friends '. [SEP] however, he said, the new vote has failed to a date. [SEP] and then, [SEP]", "detok_text": "[CLS] have thought for now, even in the deep dark, of the story's glory. [SEP] of that, there are a total of 1, 000... [SEP] 1 ), at the boil, in turn, for a day, is as big as a pan of red bread, and no gas is needed. [SEP] \" it's important that we can have a genuine resolve. [SEP] whether this is a really bad line, or not. [SEP] she even gets to sing for the new group - - 'my friends'. [SEP] however, he said, the new vote has failed to a date. [SEP] and then, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS] to help a person buy,, well, a rubber chair, or two - pack of pillows. [SEP] the panel wanted to act, just to sort it out a bit, and i decided this to be a way to keep the conversation going for years. [SEP] it was like, late into the day, you have to work hard together.... [SEP] however, he is the type to work, and he still needs to go out and get his way around. [SEP] i, up again and again, that day, afternoon and afternoon, and, after the week, the day, the day after, i went to the [SEP]", "detok_text": "[CLS] to help a person buy,, well, a rubber chair, or two - pack of pillows. [SEP] the panel wanted to act, just to sort it out a bit, and i decided this to be a way to keep the conversation going for years. [SEP] it was like, late into the day, you have to work hard together.... [SEP] however, he is the type to work, and he still needs to go out and get his way around. [SEP] i, up again and again, that day, afternoon and afternoon, and, after the week, the day, the day after, i went to the [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] all ages. [SEP] mr. lecce. [SEP] of course, he is wrong, but he is a joke. [SEP] i think that, a lot, has to be said, and wait, there are some options for change, so that we are having a referendum on things. [SEP] but still, look a little closer, especially in the first half, and you will be able to get down for you. [SEP] in fact, i can e - type it on the allergy in relation to the bread, butter, chit, milk, cheese, and bread - cheese. [SEP] the association also calls for councils to pay [SEP]", "detok_text": "[CLS] all ages. [SEP] mr. lecce. [SEP] of course, he is wrong, but he is a joke. [SEP] i think that, a lot, has to be said, and wait, there are some options for change, so that we are having a referendum on things. [SEP] but still, look a little closer, especially in the first half, and you will be able to get down for you. [SEP] in fact, i can e - type it on the allergy in relation to the bread, butter, chit, milk, cheese, and bread - cheese. [SEP] the association also calls for councils to pay [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] ago, but that was not even a good story. [SEP] as bernanke is known, brown, brown, brown, brown, brown, brown, the rat, the dumpling, the swi, the bakek - dog, the sheep, the goats, the sheep, and the dog, the bi - racial - etc. [SEP] \" we are here for day, day, night, and night. [SEP] \" not one, not one - - maybe he can be a defender, \" he said. [SEP] mr brown also warned he would not face difficult working conditions for the afghan police forces, even if he had [SEP]", "detok_text": "[CLS] ago, but that was not even a good story. [SEP] as bernanke is known, brown, brown, brown, brown, brown, brown, the rat, the dumpling, the swi, the bakek - dog, the sheep, the goats, the sheep, and the dog, the bi - racial - etc. [SEP] \"we are here for day, day, night, and night. [SEP]\" not one, not one - - maybe he can be a defender, \" he said. [SEP] mr brown also warned he would not face difficult working conditions for the afghan police forces, even if he had [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] sort of pushed back three times in over a week but had to take his chance to drop out of the race. [SEP] \" the first shot from the beginning, the one - hit, the more than 500, the jets, the nets, the celtics, and they ' re all together, \" he said. [SEP] jason satter was the director of the 15 - year - old in the history of the golden states, and was a producer on the 20 - member project. [SEP] a row of students and two staff took place at the end of the school in february 2006. [SEP] a liar, \" he will not have the beans [SEP]", "detok_text": "[CLS] sort of pushed back three times in over a week but had to take his chance to drop out of the race. [SEP] \"the first shot from the beginning, the one - hit, the more than 500, the jets, the nets, the celtics, and they're all together,\" he said. [SEP] jason satter was the director of the 15 - year - old in the history of the golden states, and was a producer on the 20 - member project. [SEP] a row of students and two staff took place at the end of the school in february 2006. [SEP] a liar, \" he will not have the beans [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] road. [SEP] the magic led, 38 - 17, including 15 points into the game. [SEP] the bottom line is that the day is the last week, period, and then you get out the window... [SEP] i.... trains, planes and, of course, road cars, roads, buses, trains, and trains. [SEP] government officials have said the plane had begun delivering back to the airport in 2004, but that the flight - 93 was named for the repair crew. [SEP] yeah, the fat - duck question needs to be answered and put in the... [SEP] it ' s gone on, but [SEP]", "detok_text": "[CLS] road. [SEP] the magic led, 38 - 17, including 15 points into the game. [SEP] the bottom line is that the day is the last week, period, and then you get out the window... [SEP] i.... trains, planes and, of course, road cars, roads, buses, trains, and trains. [SEP] government officials have said the plane had begun delivering back to the airport in 2004, but that the flight - 93 was named for the repair crew. [SEP] yeah, the fat - duck question needs to be answered and put in the... [SEP] it's gone on, but [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] from time to time to in..... then again, that was the tv at the time to turn to day to day - - right before the screen. [SEP] it is the moment in front of the start of a meal and by the end, just to make a basket at the end. [SEP] the other aircraft did not show up at to 1, 000 feet, or by helicopter. [SEP] he wanted to hold his breath when the news fell out, before getting off to end when he was not going to start again. [SEP] it was a black, back in 2003, a pre - season, half - in. [SEP]", "detok_text": "[CLS] from time to time to in..... then again, that was the tv at the time to turn to day to day - - right before the screen. [SEP] it is the moment in front of the start of a meal and by the end, just to make a basket at the end. [SEP] the other aircraft did not show up at to 1, 000 feet, or by helicopter. [SEP] he wanted to hold his breath when the news fell out, before getting off to end when he was not going to start again. [SEP] it was a black, back in 2003, a pre - season, half - in. [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS], on the edge of the pool in the double - story bed, sits on a piece of deep - brown paper. [SEP] on the other side of the road some of the anti - protesters protest at the soldiers ' deaths. [SEP] and it might have had to do to the big time, non - money - - the whole thing has never stopped. [SEP] but in the end, it was usually, just once a year, but a year later, for a lot of months now, and a three years later, it will never have been again. [SEP] but for a moment we just have begun. [SEP] the 36 - year - [SEP]", "detok_text": "[CLS], on the edge of the pool in the double - story bed, sits on a piece of deep - brown paper. [SEP] on the other side of the road some of the anti - protesters protest at the soldiers' deaths. [SEP] and it might have had to do to the big time, non - money - - the whole thing has never stopped. [SEP] but in the end, it was usually, just once a year, but a year later, for a lot of months now, and a three years later, it will never have been again. [SEP] but for a moment we just have begun. [SEP] the 36 - year - [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] championship, and sports council officials said johnson ' s focus was beyond on four games, three - hour games, two games and a one - game - - two - week event. [SEP] it ' s 1, 000 acres, a 100, 000 - acre area. [SEP] however, for good, everything, which seems like nothing, is rubbish. [SEP] \" we are already in the works to have something to go down, a lot to move in with us. [SEP] \" the thought was ' yes, if they come out, \" he said. [SEP] the cause of the crash, which happened a couple of hours after the road was [SEP]", "detok_text": "[CLS] championship, and sports council officials said johnson's focus was beyond on four games, three - hour games, two games and a one - game - - two - week event. [SEP] it's 1, 000 acres, a 100, 000 - acre area. [SEP] however, for good, everything, which seems like nothing, is rubbish. [SEP] \"we are already in the works to have something to go down, a lot to move in with us. [SEP]\" the thought was' yes, if they come out, \" he said. [SEP] the cause of the crash, which happened a couple of hours after the road was [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS], have to sell their money in a country, for free, or for the eu, or in italy. [SEP] that said it was the place to be done, and to feel, in a cold local room, we would take a few hours to try out the cheese, place and place it together on a final package, a black - white dip, half - red meats, carrots and salt, vanilla and black - pepper. [SEP] the federal government ' s new savings figure, released in february, fell sharply from the 7. 9 percent - year figure from the same period in november last year. [SEP] \" at the [SEP]", "detok_text": "[CLS], have to sell their money in a country, for free, or for the eu, or in italy. [SEP] that said it was the place to be done, and to feel, in a cold local room, we would take a few hours to try out the cheese, place and place it together on a final package, a black - white dip, half - red meats, carrots and salt, vanilla and black - pepper. [SEP] the federal government's new savings figure, released in february, fell sharply from the 7. 9 percent - year figure from the same period in november last year. [SEP] \" at the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] 3 days, days, days, days, 14 days..... and 4 days, 3 days, 2 days, days, 2 days, days, 3 days, 14 days, days, days, 2 days, 2 days, days, days, days, 11 days, days, days, 12 days, 4 days, days, 4 days and 4 days, days, days, back together on a normal days, and 2 hours and days in hours, days, days. [SEP] then, come the sun the sun, and then there is a little bit of sun. [SEP] that ' s a great idea to [SEP]", "detok_text": "[CLS] 3 days, days, days, days, 14 days..... and 4 days, 3 days, 2 days, days, 2 days, days, 3 days, 14 days, days, days, 2 days, 2 days, days, days, days, 11 days, days, days, 12 days, 4 days, days, 4 days and 4 days, days, days, back together on a normal days, and 2 hours and days in hours, days, days. [SEP] then, come the sun the sun, and then there is a little bit of sun. [SEP] that's a great idea to [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS], according to the international monetary bank. [SEP] they said in a statement that there is a lot of evidence in their efforts to move on the issue. [SEP] it turns out that the race line is written in real knots. [SEP] today, we are in the mid - 50, 50,, 50, a year of the day. [SEP] 4, 2, 10, 15, 14, 17,, 16, 15, 21, 15, 26, 15,, 15, 16, 15, 49, 37. [SEP] in the summer of 2008, rbs reported $ 90, 000 in security costs between now and december 2000, [SEP]", "detok_text": "[CLS], according to the international monetary bank. [SEP] they said in a statement that there is a lot of evidence in their efforts to move on the issue. [SEP] it turns out that the race line is written in real knots. [SEP] today, we are in the mid - 50, 50,, 50, a year of the day. [SEP] 4, 2, 10, 15, 14, 17,, 16, 15, 21, 15, 26, 15,, 15, 16, 15, 49, 37. [SEP] in the summer of 2008, rbs reported $90, 000 in security costs between now and december 2000, [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] home -owners, welfare and jobs ). [SEP] it seems that the security measures are most likely to be put in place up to now. [SEP] the sense of fear surely will not gain before the minds of students return to participating in their school life. [SEP] with a little more depth,, then, then, sometimes, and sautes. [SEP] pittsburgh, panthers 2 mike danley got the second goal and five assists in a 2 - 2 victory, and mike fisher scored the first - goal early of the game to seal the win. [SEP] then, a remember... the boys come into love with me. [SEP] [SEP]", "detok_text": "[CLS] home -owners, welfare and jobs ). [SEP] it seems that the security measures are most likely to be put in place up to now. [SEP] the sense of fear surely will not gain before the minds of students return to participating in their school life. [SEP] with a little more depth,, then, then, sometimes, and sautes. [SEP] pittsburgh, panthers 2 mike danley got the second goal and five assists in a 2 - 2 victory, and mike fisher scored the first - goal early of the game to seal the win. [SEP] then, a remember... the boys come into love with me. [SEP] [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] in advance of the christmas olympics. [SEP] the bread is crisp on the outside, with the top with all the butter and juices - - to return in a small pan to the bottom. [SEP] he led his club to the conference floor when the game ended. [SEP] but, it ' s hard to imagine the americans making such a point. [SEP] the service sector and the contract are expected to reach a 16. 0 - m ( 1 ) - 3m depth at the time ( 16. 2m ). [SEP] for some of these, he just turns to, ' s ( er ), and he is.... [SEP]", "detok_text": "[CLS] in advance of the christmas olympics. [SEP] the bread is crisp on the outside, with the top with all the butter and juices - - to return in a small pan to the bottom. [SEP] he led his club to the conference floor when the game ended. [SEP] but, it's hard to imagine the americans making such a point. [SEP] the service sector and the contract are expected to reach a 16. 0 - m (1) - 3m depth at the time (16. 2m). [SEP] for some of these, he just turns to,'s (er), and he is.... [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS],,,,,,,,,,, and the end. - - - - - down the road.. - -, well, we ' re going to get a more field day in the end, some point, maybe, and we will have to buy a real plan, but we have a better day with a better picture. [SEP] 4 ( upi ) - - toronto blue bulls, u. s. team toronto, bulls - - the bulls was back in boston for the second straight no. 1. [SEP] \" the situation goes back to 1997. [SEP] so, these days, the creation of a group [SEP]", "detok_text": "[CLS],,,,,,,,,,, and the end. - - - - - down the road.. - -, well, we're going to get a more field day in the end, some point, maybe, and we will have to buy a real plan, but we have a better day with a better picture. [SEP] 4 (upi) - - toronto blue bulls, u. s. team toronto, bulls - - the bulls was back in boston for the second straight no. 1. [SEP] \" the situation goes back to 1997. [SEP] so, these days, the creation of a group [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS]. [SEP] if we stick to a similar conversation, then say, \" that was, to be more casual, what we all wanted to do. [SEP] the course of everything, the start of the week at the end of the day, for days, and then again in year, week, after day. [SEP] at the end of september 2009, there was the increase in additional loan losses at an average value of $ 4. 8 million, up from $ 11. 9 million, in the same period of 2009. [SEP] the shares need to be sold - - or, say, a better - - sold. [SEP] 1845 : we [SEP]", "detok_text": "[CLS]. [SEP] if we stick to a similar conversation, then say, \" that was, to be more casual, what we all wanted to do. [SEP] the course of everything, the start of the week at the end of the day, for days, and then again in year, week, after day. [SEP] at the end of september 2009, there was the increase in additional loan losses at an average value of $4. 8 million, up from $11. 9 million, in the same period of 2009. [SEP] the shares need to be sold - - or, say, a better - - sold. [SEP] 1845: we [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] he brought down the front page is... [SEP] sevek, 13 : 10 minutes - - half, half, half, half and half - again, but it was about half - hour, half - time. [SEP] by day, day, day of the week, half - day, wake - up period, how much that time, how little is changed in. [SEP] finally, instead of a minute - just long enough to forget and take a further look at it. [SEP] instead, they are learning to put on the bed, so go to bath, in which they have access to get paid to a play. [SEP]", "detok_text": "[CLS] he brought down the front page is... [SEP] sevek, 13: 10 minutes - - half, half, half, half and half - again, but it was about half - hour, half - time. [SEP] by day, day, day of the week, half - day, wake - up period, how much that time, how little is changed in. [SEP] finally, instead of a minute - just long enough to forget and take a further look at it. [SEP] instead, they are learning to put on the bed, so go to bath, in which they have access to get paid to a play. [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS], 24, of leytons, was arrested. [SEP] then 65, 65, 60, 50 in the morning and then half - 52.... for the afternoon, -..., - - 50, 50, a - 60, a - 52, the celtics were 50, 60, 50, 50, and 50 - - and, after all, 50, 50 - - 50, 50, 60, 50, 50,, 52. [SEP] today, a week, 24, 40, 37, 50, 50, and time in the afternoon, for 30 to 45 seconds. [SEP] in australia, the [SEP]", "detok_text": "[CLS], 24, of leytons, was arrested. [SEP] then 65, 65, 60, 50 in the morning and then half - 52.... for the afternoon, -..., - - 50, 50, a - 60, a - 52, the celtics were 50, 60, 50, 50, and 50 - - and, after all, 50, 50 - - 50, 50, 60, 50, 50,, 52. [SEP] today, a week, 24, 40, 37, 50, 50, and time in the afternoon, for 30 to 45 seconds. [SEP] in australia, the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] - hour, 80 - mile journey, taking nearly a year to get by. [SEP] the fall - off corruption trial took place when the court heard that a brazilian businessman had lost over 25, 000 hectares worth of land. [SEP] all his work, the wooden structure - - based on long, period structure - - became the story of the installation. [SEP] easttown, s. s. vancouver, sept. [SEP] while he ' s just for christmas - - the end of the christmas season - - his son, chris, has had a decent campaign this week - - perhaps. [SEP] 4 ( upi ) - - u. s [SEP]", "detok_text": "[CLS] - hour, 80 - mile journey, taking nearly a year to get by. [SEP] the fall - off corruption trial took place when the court heard that a brazilian businessman had lost over 25, 000 hectares worth of land. [SEP] all his work, the wooden structure - - based on long, period structure - - became the story of the installation. [SEP] easttown, s. s. vancouver, sept. [SEP] while he's just for christmas - - the end of the christmas season - - his son, chris, has had a decent campaign this week - - perhaps. [SEP] 4 (upi) - - u. s [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] typically trade in at 90 % - 40 % in current market prices, and do not rise until further in the winter. [SEP] put out of the juices, cut in a large saucepan, and season the butter and ice at half - hour time. [SEP] and the same thing could have happened.... [SEP] in a bowl, place for a close and reduce to half - size flour, bring in a place, so that is a more satisfying choice for the whole family. [SEP] ian wexer, a researcher with the medical office, examined the children in one of their studies. [SEP] the move came to months in [SEP]", "detok_text": "[CLS] typically trade in at 90 % - 40 % in current market prices, and do not rise until further in the winter. [SEP] put out of the juices, cut in a large saucepan, and season the butter and ice at half - hour time. [SEP] and the same thing could have happened.... [SEP] in a bowl, place for a close and reduce to half - size flour, bring in a place, so that is a more satisfying choice for the whole family. [SEP] ian wexer, a researcher with the medical office, examined the children in one of their studies. [SEP] the move came to months in [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS]. [SEP] yes, \" white house spokesman gordon young said. [SEP] so clearly, for after days, the perfect time to go, to take the trail back to, after dark, back in the dark place. [SEP] he tells us, and, then, then, why not only is he mean, really, but also he, he said, he is. [SEP] a pan of coconut butter hung on the right side of a rice, thin - scented baking machine. [SEP] unfortunately, america is unable to stand the balance again ( and then again, of course,, again, again and again ) on the line to the original and [SEP]", "detok_text": "[CLS]. [SEP] yes, \" white house spokesman gordon young said. [SEP] so clearly, for after days, the perfect time to go, to take the trail back to, after dark, back in the dark place. [SEP] he tells us, and, then, then, why not only is he mean, really, but also he, he said, he is. [SEP] a pan of coconut butter hung on the right side of a rice, thin - scented baking machine. [SEP] unfortunately, america is unable to stand the balance again (and then again, of course,, again, again and again) on the line to the original and [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]. [SEP] 2. 6bn ) to multi - year investment gains made in the last three years, up to 0. 6 per cent year - on - year, year - to - year - to - date up from 4. 7 per cent in 1998 - 07. [SEP] \" business travel is driven by entrepreneurship, \" she said. [SEP] i ' ve had to say everything, and we ' ve got to talk. [SEP] however, according to his brother david, who led the investigation, \" he was able to go back.. [SEP] and then again, then, now, now and again. [SEP] \" if i could get [SEP]", "detok_text": "[CLS]. [SEP] 2. 6bn ) to multi - year investment gains made in the last three years, up to 0. 6 per cent year - on - year, year - to - year - to - date up from 4. 7 per cent in 1998 - 07. [SEP] \"business travel is driven by entrepreneurship,\" she said. [SEP] i've had to say everything, and we've got to talk. [SEP] however, according to his brother david, who led the investigation, \"he was able to go back.. [SEP] and then again, then, now, now and again. [SEP]\" if i could get [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] in traditional schools. [SEP] shoes are often visible - - and largees of shoes, blankets, harnesses and linens are just to follow. [SEP] \" we took some of the essence of the show ' s character from time to time to time, \" he says. [SEP] if you want to act, let us laugh, feel, talk, think - - eat, to get home and a bit of sleep. [SEP] today, here he was by side, in the back - room, in a short, quiet place in the middle of night, and in the centre of the evening, he can be, for days, a [SEP]", "detok_text": "[CLS] in traditional schools. [SEP] shoes are often visible - - and largees of shoes, blankets, harnesses and linens are just to follow. [SEP] \"we took some of the essence of the show's character from time to time to time,\" he says. [SEP] if you want to act, let us laugh, feel, talk, think - - eat, to get home and a bit of sleep. [SEP] today, here he was by side, in the back - room, in a short, quiet place in the middle of night, and in the centre of the evening, he can be, for days, a [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] period, and the time to,,,,,,,, starting with a week,,, no one,,,,,... and, then, again, the rest is enough to do everything again... [SEP] it is very bad and wants to do it more efficiently. [SEP] the work of dr. spitz, a mathematician, who jumps and writes,,,,,, days in the back of a plane, takes for a lot of days for the beginning, then, sometimes, then,, to come up with check - in beginning, then set up on a path in the end [SEP]", "detok_text": "[CLS] period, and the time to,,,,,,,, starting with a week,,, no one,,,,,... and, then, again, the rest is enough to do everything again... [SEP] it is very bad and wants to do it more efficiently. [SEP] the work of dr. spitz, a mathematician, who jumps and writes,,,,,, days in the back of a plane, takes for a lot of days for the beginning, then, sometimes, then,, to come up with check - in beginning, then set up on a path in the end [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] s way of things, which is his own goal. [SEP] it is a great indeed. [SEP] the good thing is, remember, if a coach is get out of the deal, but he has hit over the top of it in the deal, that he makes the deal again, on the plane, on dhl today. [SEP] 2007 - - - - - - - - - - - - - - - - - - as of december 31, 2007, 31 - 2007 - 13, 0230 - £29, 000 - £175, 000, in 2008 - 31, 000 - 300. the actual number 501 ( 1 [SEP]", "detok_text": "[CLS] s way of things, which is his own goal. [SEP] it is a great indeed. [SEP] the good thing is, remember, if a coach is get out of the deal, but he has hit over the top of it in the deal, that he makes the deal again, on the plane, on dhl today. [SEP] 2007 - - - - - - - - - - - - - - - - - - as of december 31, 2007, 31 - 2007 - 13, 0230 - £29, 000 - £175, 000, in 2008 - 31, 000 - 300. the actual number 501 ( 1 [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] 2010, it is clear. [SEP] however, the end of 2006 was a first step. [SEP] and there is more to come to make of, and very few excuses. [SEP] in fact, the crowd roared and then finally brought it to a halt, quickly turning the show into again. [SEP] the producers realize, however, that works like pillows and rinses are just examples of a child stopper ' s passion for child care. [SEP] \" in the face of this road, i urge you to read this constitution, to make sure to be better, working, to get better and stay better, \" said the u. s [SEP]", "detok_text": "[CLS] 2010, it is clear. [SEP] however, the end of 2006 was a first step. [SEP] and there is more to come to make of, and very few excuses. [SEP] in fact, the crowd roared and then finally brought it to a halt, quickly turning the show into again. [SEP] the producers realize, however, that works like pillows and rinses are just examples of a child stopper's passion for child care. [SEP] \"in the face of this road, i urge you to read this constitution, to make sure to be better, working, to get better and stay better,\" said the u. s [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] health care. [SEP] i sat in the office for a minute of a single day, when he wanted to look me in the mirror, and got the answer. [SEP] the man who wrote, and spoke in italian, a fake and a fake, was photographed with the minister ' s apron, and the answer was written in white. [SEP] the forecast is expected to bring to 10 - 15, 000 tonnes of power capacity in the second quarter. [SEP] that means a top aide revenue rate of an additional 11 percent. [SEP] los angeles - the celtics have stumbled to a first victory in a playoff game, the first coming at the end of [SEP]", "detok_text": "[CLS] health care. [SEP] i sat in the office for a minute of a single day, when he wanted to look me in the mirror, and got the answer. [SEP] the man who wrote, and spoke in italian, a fake and a fake, was photographed with the minister's apron, and the answer was written in white. [SEP] the forecast is expected to bring to 10 - 15, 000 tonnes of power capacity in the second quarter. [SEP] that means a top aide revenue rate of an additional 11 percent. [SEP] los angeles - the celtics have stumbled to a first victory in a playoff game, the first coming at the end of [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] stories and poetry, and so there are people to find historical and useful items from history. [SEP] in addition, the national civil ' union, john kelly, wanted to make a comment on the deal in return so that companies would not be able to fund large \" post - contract \" - related work. [SEP] he told bbc news \" one of a number of members at the wirral trust has been campaigning in favour of extending the line service. [SEP] i know, that is incredible. [SEP] so - - well, it would be that he has to \" reckoned with respect \" and the rest has to stop. [SEP] but then, [SEP]", "detok_text": "[CLS] stories and poetry, and so there are people to find historical and useful items from history. [SEP] in addition, the national civil' union, john kelly, wanted to make a comment on the deal in return so that companies would not be able to fund large \"post - contract\" - related work. [SEP] he told bbc news \"one of a number of members at the wirral trust has been campaigning in favour of extending the line service. [SEP] i know, that is incredible. [SEP] so - - well, it would be that he has to\" reckoned with respect \" and the rest has to stop. [SEP] but then, [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] well as the nation, \" he said. [SEP] the day ' s event was a two - hour period as it turned into a start - off. [SEP] then a - 4,, 5, 5, 5, and - - on a 10 - yard,, 11, 13, 100 - yard, and yard rally from a 10 - point, 11, for - 10 news conference. [SEP] it is a change of direction. [SEP] the majority of the bank ' s assets are in commercial mortgage - backed commercial securities, with most assets in relation to mortgage - backed securities, including fixed - income and other junior mortgages. [SEP] [SEP]", "detok_text": "[CLS] well as the nation, \" he said. [SEP] the day's event was a two - hour period as it turned into a start - off. [SEP] then a - 4,, 5, 5, 5, and - - on a 10 - yard,, 11, 13, 100 - yard, and yard rally from a 10 - point, 11, for - 10 news conference. [SEP] it is a change of direction. [SEP] the majority of the bank's assets are in commercial mortgage - backed commercial securities, with most assets in relation to mortgage - backed securities, including fixed - income and other junior mortgages. [SEP] [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] $ 15 billion, down earnings a share in the first quarter. [SEP] i was not sure to look at, anywhere in his face - and then, and gone along with his way to talk about the job. [SEP] he just seems not to believe it ' s true. [SEP] so why do they want me to take the other children to their school and to the house and i ' d have to watch the same thing again. [SEP] a police spokesman said : \" this is an incredible mix of dark, orange, and blue, and like. [SEP] i feel like, i wonder why the council might want to turn it into a less [SEP]", "detok_text": "[CLS] $15 billion, down earnings a share in the first quarter. [SEP] i was not sure to look at, anywhere in his face - and then, and gone along with his way to talk about the job. [SEP] he just seems not to believe it's true. [SEP] so why do they want me to take the other children to their school and to the house and i'd have to watch the same thing again. [SEP] a police spokesman said: \" this is an incredible mix of dark, orange, and blue, and like. [SEP] i feel like, i wonder why the council might want to turn it into a less [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/summary.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/summary.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..e07c0606d21e15e6bdb9515e331dae1ff9c8fe73 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/summary.jsonl @@ -0,0 +1,2 @@ +{"type": "summary", "name": "state_c256_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c256_t1p45", "steps": 32, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 44.930859242990756, "nll_per_token": 3.8051248469363923, "tokens": 9366}, "diversity": {"sample_entropy": 3.7823763722555808, "unique_tokens": 1422, "token_count": 8192, "distinct_1": 0.173583984375, "distinct_2": 0.5745570866141733, "top_token_mass": 0.11572265625}} +{"type": "summary", "name": "state_c1024_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c1024_t1p45", "steps": 32, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 31.13635173493272, "nll_per_token": 3.438376002668099, "tokens": 9165}, "diversity": {"sample_entropy": 3.3146319833825286, "unique_tokens": 1102, "token_count": 8192, "distinct_1": 0.134521484375, "distinct_2": 0.4309793307086614, "top_token_mass": 0.2288818359375}} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/summary.tsv b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/summary.tsv new file mode 100644 index 0000000000000000000000000000000000000000..80830ce9b2fec56a5755824facfc24baddf0192d --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_32/summary.tsv @@ -0,0 +1,3 @@ +name step detok_genppl sample_entropy distinct_2 top_token_mass model_t_mode support_power semantic_power final_from endpoint_temp concentration_max update +state_c256_t1p45 124000 44.930859242990756 3.7823763722555808 0.5745570866141733 0.11572265625 post 1.0 1.0 state 1.45 256.0 resample +state_c1024_t1p45 124000 31.13635173493272 3.3146319833825286 0.4309793307086614 0.2288818359375 post 1.0 1.0 state 1.45 1024.0 resample diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/state_c1024_t1p45_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/state_c1024_t1p45_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..ed869b9d99399a860bad913bcb88da29a95356c3 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/state_c1024_t1p45_detok_raw_samples.txt @@ -0,0 +1,228 @@ +state_c1024_t1p45_detok +{ + "type": "summary", + "name": "state_c1024_t1p45", + "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", + "step": 124000, + "decode": { + "kind": "categorical_fullvocab", + "config": "state_c1024_t1p45", + "steps": 64, + "model_t_mode": "post", + "support_power": 1.0, + "semantic_power": 1.0, + "endpoint_temp": 1.45, + "concentration_min": 1.0, + "concentration_max": 1024.0, + "final_from": "state", + "update": "resample", + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 35.36294023649359, + "nll_per_token": 3.565664385797097, + "tokens": 9515 + }, + "diversity": { + "sample_entropy": 3.884623591993139, + "unique_tokens": 1443, + "token_count": 8192, + "distinct_1": 0.1761474609375, + "distinct_2": 0.5751722440944882, + "top_token_mass": 0.1007080078125 + } +} + +===== sample 000 ===== +[CLS], 2003, when the woman failed to meet in the afghanistan - pakistan border area, police said. [SEP] he doesn't mind a car, his father doesn't like being a cat or dog, so he can cope with the strain of being a dog. [SEP] (at least) now i have learned about the special qualities that make me sweat. [SEP] and sometimes he's too angry - - just to austere his way. [SEP] "i think we all need to get to that place and know it's what we really want," he said. [SEP] so i didn't just want to see the [SEP] + +===== sample 001 ===== +[CLS], and it failed to come up without an effect to the law. [SEP] i'll have much work to do, get to get a job, get back in the house. [SEP] the woman has been told: "i don't want you to walk on an airplane. [SEP]" he spent his days, days, a week, and then days a week, the days, days to stay, days to get back to, end, the time of days, days, the time to work days, the time to work, and finally to be together, " al - ha, according to the magazine. [SEP] he, [SEP] + +===== sample 002 ===== +[CLS] said. [SEP] but the show prides itself, too, in the appearance of a good program, which ends with a lot to do. [SEP] mike brown had 13 points and four assists in a season - high victory to give the thunder the halftime lead. [SEP] after watching the first - round games with the jets, two games in the next two games, the two games of the games, and then the jets of the games, buffalo has to get to detroit, win the game, game - to - game, and get to victory. [SEP] however, i'm confident of their support. [SEP] there is also no shortage of [SEP] + +===== sample 003 ===== +[CLS] oh,, well, it was a little harder, at the moment - and, well, it was like a little bit of a joke. [SEP] i still recommend it for you, but there's a bed, spa, a door, a coffee bar, a chair so you can't sign for a tree. [SEP] and we have to watch on that situation. [SEP] the man who stands up and talks with his wife said, once again, i'm beginning to realize that he is getting ready to do it. [SEP] the marlins, losing for the first time in their third game, are in a series of four [SEP] + +===== sample 004 ===== +[CLS]. s. stores in parts of washington, chicago, new york, denver and chicago. [SEP] after all, i do not want to talk about it. [SEP] " i don't think of anything to show a decline of 50. 3 %. [SEP] the american government has already shown that i don't want a political leader to make a pledge to speak up to our soldiers in iraq and the american people have to put them to work with the troops and people of afghanistan. [SEP] no, the picture ends with the lights, the yellow shirts, hands with the colors, a black mask - -... [SEP] to read [SEP] + +===== sample 005 ===== +[CLS] hard to believe. [SEP] i'm sorry, and you want me to do that, and i do it anyway. [SEP] "you get to work a hard, yeah, i get to work," she said, "yes." [SEP] and, yeah, oh, yeah, and maybe in the top 20. [SEP] the contrast is found, in the middle, the one - sided side, in the top, and in the other half of the top. [SEP] and so, if they are going to get in trouble, there's still room for some improvement. [SEP] then, though, they were all about, what [SEP] + +===== sample 006 ===== +[CLS] the country. [SEP] of course, it isn't enough to be a hit, to replace the iphone with the pay - off - - and to cut it back further - - until the next time. [SEP] while i think that relationship will be better, i've been wrong, maybe, nothing. [SEP] for the past 20 years, years, days,, weeks, years, and months, for us to come back on the road, and then again, maybe, again... and then we get back in a bad spiral, and we have managed to get down to a halt. [SEP] the campaign also has a [SEP] + +===== sample 007 ===== +[CLS] said. [SEP] but, there must be a national government trying to eliminate the divide between muslims and republicans. [SEP] "thousands of iranians have never been to democracy because they have been engaged to peaceful demonstrations and are involved in making a political deal. [SEP] the latest difference to history is that the jets are on offense at the end of the season. [SEP] the answer is not for the ultimate reason, but the answer itself. [SEP]" the world series is getting us back in the world and lord's is ok, that's ok... [SEP] the audience had an emotional capacity to admit - - even to admit - - [SEP] + +===== sample 008 ===== +[CLS] years after israel's capture. [SEP] i think the whole thing is just, well, very good. [SEP] i think it's going to change a lot to that. [SEP] it's time the audience refuses to reflect on the foundation of a creator. [SEP] everything from long shorts, leather pants, silk shirts, raincoats, cut - back jackets and hood - covered tops, grey - banded vests, copper - colored shirts, black suspenders - and - tops. [SEP] sub - prime securities, the firm, was involved in the swap, which saw each of the 500 vehicles on a debt list. [SEP] what [SEP] + +===== sample 009 ===== +[CLS], that it would consider limiting voting rights for the funds. [SEP] he had the ability to talk, to talk, to talk, not even speak. [SEP] she opens the door in search of assistance. [SEP] if you can move back and move back alone, the employer would not put you back to work again. [SEP] in return, add together the butter and add a little vanilla. [SEP] about a dozen other items - - bundles of plastic, plastic, furniture and aluminum - - have gone out of circulation since 2002. [SEP] the authorities have put a similar case behind hold in the uk. [SEP] " for a certain number of our customers [SEP] + +===== sample 010 ===== +[CLS] anti - related, the federal food and drug administration said on tuesday. [SEP] ap news' jim scirillo in mexico city and glen johnson in washington contributed to this report. [SEP] but he did not address any need for donations. [SEP] in addition to requests for comment from european authorities, the u. s. embassy declined to return phone calls to the associated press for any further comment on tuesday. [SEP] he wanted them to be on the offensive line. [SEP] "i don't think that we would get much rest anytime soon," said gordon brown, the chairman of the american asset management association. [SEP] the other side, to [SEP] + +===== sample 011 ===== +[CLS] finally showed up. [SEP] " it's going to be an opportunity to have one of us give you all the money. [SEP] i'm glad a nice, red - haired person who needs to get your family together wants to give you something, such as taking them up for a car, a bed and a room. [SEP] the mental health team examined the results of a forensic examination and the backgrounds of the suspects. [SEP] 104. 85, 84, 104, 84, 98 - 113.... [SEP] the carrier - - airlines - - can operate thousands of flights to the entire united states. [SEP] with the exception of [SEP] + +===== sample 012 ===== +[CLS] - 30 % higher than in 2007. [SEP] at the other end of 2 a. m., then 8, 8, 9, 11, 11, 15, and 10, 16, and 18, to get 4, 5, 4, 4, 6, 6, and back on time. [SEP] i stepped into her car and it had been a while, and she needed to do, "he said. [SEP] and if you do, a good person in the world will have a place to go or to do a job. [SEP]" i really think he deserves to be in the race, " said ridley - thomas, [SEP] + +===== sample 013 ===== +[CLS], he said. [SEP] he winced, hugged, the crowd froze, and exhaled. [SEP] but, there do appear to be some problems: "i found the mattress in, on occasion, the passenger drawer." [SEP] as a result, he comes out and he says, " yeah, he has a lot to do. [SEP] i'm not sure until the lights come out and,,,,,,, all the time, don't know, what,,,, what,,, what, what,. [SEP] the industry, flush with money, has run out of cars, planes, cars and planes [SEP] + +===== sample 014 ===== +[CLS]. [SEP] but for a long time, it has to be taken with, he said, "a great effect." [SEP] the project is also a private investment, as part of the sale to the bank of scotland. [SEP] for now, everyone are able to get their names together - - 2, 3, 14,, 8, 12, 11, 13, a word. [SEP] i think so well. [SEP] "i wanted him to talk to him," she added. [SEP] "i continue to love him for all," he said. [SEP] but if there is anything to go by, it doesn't work. [SEP] + +===== sample 015 ===== +[CLS] " she said. [SEP] so much so i spent my days trying to get back to the house - i would drink in transit, i would never die in a tunnel on a bus - and it came along, so far, so quickly, just because it would stop, and then, then later, off the road. [SEP] then, every day, i mean, 49, 37, 50, i usually have 200, 200, 50, 50, 60 days. [SEP] on a short voyage, the aircraft carried aircraft, planes and equipment to the roof of the united nation's fueling system. [SEP] i agree with your assertion [SEP] + +===== sample 016 ===== +[CLS] happens on wall, say, rather, newspapers, it is no reflection of their diversity. [SEP] the story doesn't seem to work out the only way of finding a way to feel bad news. [SEP] we started with a computer, two minutes, a few minutes, looking at the hotel's small door, looking in its yard. [SEP] a 45 - year - old french student who says she wrote her boyfriend's name is on the stand, a court heard. [SEP] i have been in the field since the age of 17, but i never had one. [SEP] but i just think that with the obvious problems, there [SEP] + +===== sample 017 ===== +[CLS] investors, would seem to include the idea of a short - term buy - out. [SEP] what makes an even greater problem, the truth, is a combination of - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -. [SEP] but it's not a time to start and tell us to look here. [SEP] the 21 - year - old midfielder moved to liverpool from the club in 2006. [SEP] the house, kupech said, is expected to be a 300 - foot vehicle with a top speed of 40 miles [SEP] + +===== sample 018 ===== +[CLS] not have the opportunity to speak unless i have to listen to read the novel. [SEP] london (ap) - british transport officials have launched a "demonstration" operation over the refusal of european union airspace to allow flights to the hubble and a lack of extra transport flights so the mission can expand beyond the end of the full year. [SEP] police are keen to speak to four men, including the father of a baby, who walked in the heart of york street, eastbourne, at 0115 gmt on saturday. [SEP] by the way, fluorescent lights, candles, rubbers and candles come together, shoes, pillows, etc. [SEP] + +===== sample 019 ===== +[CLS] said. [SEP] they may have a good future in self - esteem and we have had to question the trust of children at the end of their lives. [SEP] i like the sparkle of light, i can see from the top windows, the sparkle of the ceiling, the sparkle of lights. [SEP] the bill also includes the use of emergency planes, the use of cargo planes, cargo planes, the use of passenger planes, aircraft and automobiles. [SEP] if to make it for a two - win race against the best team in the world, we are just right to keep on making the most of the game. [SEP] here, it seems, [SEP] + +===== sample 020 ===== +[CLS] "he said. [SEP] when hillary clinton told the crowd that she wanted to make" a fateful (inky) gesture out of her mouth, "my name was raised. [SEP] his coats of black tops and dark white shoes, all clouds white, a long black scarf, a black white hat, and a large - looking black top - - faded and then, again, then we all have to wait and then half,, then half,, half,, the carpet is on. [SEP] the uk's foreign minister said in a statement released on monday that it was a" significant priority " for efforts to resolve the [SEP] + +===== sample 021 ===== +[CLS]. [SEP] "it was a guy on the other side of a line, saying..., kind of" shit, wack, "he said... [SEP] there is a lot of space in all of our minds, that need to think how our lives have changed," he said a while earlier. [SEP] a bit of art, that seems to me, comes with an arm and a lot of empty mind. [SEP] "it is a law they must change, because it is so," he said. [SEP] the teen, hamilton of michigan, was arrested in a separate area just days outside his home on a [SEP] + +===== sample 022 ===== +[CLS] to be completed in one to two days. [SEP] the government statement said the school would return by december, beginning in 2014. [SEP] overby said she is concerned about the concept behind that decision when she wants to get the job done and vote for it. [SEP] some are very hard, some funky, some making it up and just trying to make a bit more than a bit bland and sweet. [SEP] chicago (reuters) - trade leaders, meeting in chicago hoping to boost trade between the u. s. and africa, will meet in a bid to forge a balance on trade, a senior official said on monday. [SEP] the company [SEP] + +===== sample 023 ===== +[CLS], the company has said it will not reveal what they are thinking about. [SEP] "unfortunately at the moment, many of us have no access to public funding, and refuse to work to deal with the enormous issues. [SEP] he never gets a chance to start, just to start in the locker room. [SEP] a small seating area has been set up inside, and large spaces in the area. [SEP]" it's like he's driving, going down in the road, going back on the street at work, going on to back, but going back - in - the - road, down the road, up there. [SEP] [SEP] + +===== sample 024 ===== +[CLS] in 2001. [SEP] the farmers, he said, will not do it until 2017, and then will make ends meet in season to season, with the current peaking at a peak of around 50c in two years. [SEP] with the lights of miami, the story turned green, green, black and green, and the dust of black faded in the wind and the stone pillars of the wall again faded. [SEP] the officials, speaking condition of anonymity, agreed that obama's withdrawal would continue until the end of the year. [SEP] no, i try to tell you the author may just be a 300 - a - word, [SEP] + +===== sample 025 ===== +[CLS] unusual, however, at this time. [SEP] people wanted to wake up to understand the situation, "said to the student, who said the noise was" fantastic "and then he got back on the ground. [SEP] i mean sorry, but then you, god, take a day for a tea, some for a pill, men and women. [SEP]" anything that will happen within the term - - when it is half a century - - will be much harder to prepare for, " he said. [SEP] the teams spent about four days a week trying to bring the best of the best of the nba chicago, june 30 ( up [SEP] + +===== sample 026 ===== +[CLS] they started to sing, they began laughing, "she said. [SEP] and, i can't understand how, for now, people are willing to drop their wallets and put their noses in the door. [SEP] the family then wanted to get a question - and - answer to where he was going, he said. [SEP]" here, the game has not come to a close. [SEP] now that the economy is back to the boom - and - bust cycles, and the process continues, the idea that everything is going in a little bit and moving is we have to wait and get a little longer. [SEP] he began with a [SEP] + +===== sample 027 ===== +[CLS] his plan, and he ruled out it would do something to some of his clients. [SEP] but a few weeks, for me, and for the fans, it has been the time for me to fight, " he said. [SEP] after a restoration, the final part of the houseboard section of the building, confined to the ceiling railings, returns to the edge of darkness. [SEP] this requirement has been put in one place. [SEP] at least 100 french soldiers have been killed. [SEP] and when i do, i take off, i feel the smell of music in my face. [SEP] he struggles with the breadth of his collection. [SEP] + +===== sample 028 ===== +[CLS] meeting in baghdad, the official told reporters. [SEP] they were the real problem and they were all on their own. [SEP] "i remember him was once standing on the other side of the room, and with him, he said, come back, look up, he said goodbye, and then he said to me, and he said yes, he was another. [SEP] and, oh, uh - oh, there's a lot. [SEP] only a few of the drugs were used in britain to treat serious kidney problems. [SEP] so, then, are the bigger problems. [SEP]" people don't wait for answers. [SEP] " [SEP] + +===== sample 029 ===== +[CLS] said. [SEP] the result of our investigation is that the internet is a priority. [SEP] i think the children will find themselves sitting in disbelief, if they are to turn around. [SEP] the financial collapse of the credit crunch, many of its names were being announced, appears to have engulfed some of the world's most susceptic economies. [SEP] even when it gets done, that kind of person eats up a hair and refuses to come. [SEP] and the message was clear that, with the end of the olympics in sight, i didn't have a sense of humor, or even the thrill of getting in a field. [SEP] + +===== sample 030 ===== +[CLS] couple of hours, i would not be able to get the full flight, he said. [SEP] but he knew, and he refused to speak. [SEP] we do not like the things that the person at the top, at a corner, at the top, at the top line, the body, to the top, the bottom line, up to the top. [SEP] while the emotional nature of the story, in which the story is taken by the author's son on a huge canvas, has settled the issue, the narrative of moyesque is far deeper than ever. [SEP] so, if i only get through the house, [SEP] + +===== sample 031 ===== +[CLS]. [SEP] the hospital has a great room and is a very nice room, a great group, " he said. [SEP] when everyone talks about him and his accomplishments, i will wonder if they are anything more, just temporary. [SEP] 7, detroit, calgary - toronto 11 - 13, detroit - boston 16, detroit - chicago, detroit - chicago, in place of chicago, detroit - denver. [SEP] more than 30 aircraft, including 13 men, women and one - third of the staff, were scheduled to leave in coming days, the coalition said. [SEP] 5 to serve as head of the special forces command. [SEP] the article appeared [SEP] + +===== sample 032 ===== +[CLS] [SEP] that is what is a situation not changed since the end of the 1970s. [SEP] the only way to do, say, say, say, say, look, it's a matter of working the hard, with little problem, trying to get the word'turn' right. [SEP] yes, however, the distinction is important. [SEP] he just started in chicago, detroit, denver, chicago, before going to the airport. [SEP] but, time is on the line, there are days to be had, now, and then, and, finally, with the chance to become, again, a half - day. [SEP] the [SEP] + +===== sample 033 ===== +[CLS] the girl, a 6 - year - old little girl. [SEP] the baby is ½ - and - 1 - - tucked up in dark pajamas, working in suitcases, bunks, and in pantsuits, in dark pants. [SEP] meanwhile, these researchers are also parachuted in to work with special equipment to deliver these additional multi - wheeled units - - including lifts, lifts, wheelchairs, lifts and - - on support of emc technology. [SEP] canada. [SEP] the plane, £1, 095 (£11, 772), has seven flights. [SEP] " it's like we're not talking. [SEP] + +===== sample 034 ===== +[CLS] chicago in chicago, chicago - to tampa, detroit, and - detroit in cleveland. [SEP] i just think he is going to step down if he doesn't plan to return. [SEP] it's 60, 50,, 50, 60, - - 50, 50 - - 50, 38, 36, 48 days. [SEP] brown had 16 points and nine rebounds, including a point game, a trip to the blue devils, and even a game in the second period. [SEP] 9, chicago 17, new jersey 18. [SEP] he refused to give his students of dollars and even told them to check in. [SEP] the court heard [SEP] + +===== sample 035 ===== +[CLS] said. [SEP] a lovely, fruit - scented version of wilt vanilla, with a paler shade of lemon flavors. [SEP] chicago is 7 - 4 with a 2 - 2 - 2 era. [SEP] it's quite a bit to learn. [SEP] "he's really so clever, he moved quickly through his acting period, and got into a place where he huffed and puffed and rolled up his teeth, opened his eyes." [SEP] there are people who have other types of financial support. [SEP] "the victory will have a huge impact," analysts say, for the fast - growing insurgency. [SEP] i never believe that a [SEP] + +===== sample 036 ===== +[CLS] began in january 2005. [SEP] other cities have made significant gains, including london, in london, and in the midlands, for the last five years. [SEP] "i think i'd just like to sleep, but when it is good, you get to sleep, not well," he said. [SEP] the next day, however, she is asleep in the next room, but the answer begins to appear, she's looking up and laughing. [SEP] " i don't think he is going to talk. [SEP] i have white shirts, white shirts, blackcoats and gray black shirts. [SEP] the complete collapse of american [SEP] + +===== sample 037 ===== +[CLS] pakistan, comes close to a solution, obama said. [SEP] he walked off in frustration and worked out side - by - side for the second time in a career - long year - - a tie with the series he began in march 2000. [SEP] but overall, the rebels did have a full advantage - - or even, perhaps - - and managed to move inside. [SEP] it may not have to work. [SEP] the aircraft also caters to 1, 200 britons, which are worth 2. 7 million tonnes - - on orders from the government - to the airport. [SEP] the company, which includes 37 airlines and cargo companies, [SEP] + +===== sample 038 ===== +[CLS] [SEP] "so it is about everyone," mr. he said. [SEP] bring out a good plan to try to keep up with the real economy. [SEP] you know, the big vampires, the elves, the elves. [SEP] we came up, dancing, the stars, that was good, but then i started, and i was really angry, "he said. [SEP]" to see that to him, he knows what's important. [SEP] israel said it would not want to return and that it would return to hamas. [SEP] at the end of the four - game day, angels starter derek matsui went back with an rbi [SEP] + +===== sample 039 ===== +[CLS] said. [SEP] but when a three - wheeled bus pulled me around, he pulled me into a corner, and pulled me into a corner. [SEP] well, so it was a great game for us. [SEP] foreign flights have been on strike over the past week, with security concerns that could also affect domestic flights. [SEP] we focus on baking, baking, baking, baking, baking, baking, baking, milk, baking, baking, tomato, mint. [SEP] if he's 21 years old, so i'm guessing, you just want him to keep working, you never look back again, he's ok, so where [SEP] + +===== sample 040 ===== +[CLS]. [SEP] in november 2002, he wrote down the bill and tried to amend the legislation. [SEP] the problem not for the jets, but for the fans and the club. [SEP] i think, from the beginning, to the end, just to the finish line. [SEP] the way the researchers are trying to point out, the problem is real. [SEP] i don't know that we have to do that, " he said. [SEP] look at the details, and then you would get me right, and then i imagine that in the case of a race, i would go - - literally - - from the end of the line. [SEP] + +===== sample 041 ===== +[CLS] s a great way to get together, i plan to spend the week in the light of my surroundings, " he said. [SEP] no one at the stadium went on holiday, we didn't know it would be back anyway. [SEP] the idea is to be able to get into something and something new, going right out of the hands of a soldier and getting out of it. [SEP] oh, oh, oh, so much gratitude, and, oh, yes, oh, i love and i love, the last thing it is to remember,,,, so much,,,,,, so much. [SEP] he was [SEP] + +===== sample 042 ===== +[CLS] in particular, but not in my personal case, they have a little smile on their faces. [SEP] for the week, the error was only about 50 %, up from 60 percent for the previous week, again in october 2008, and to 45 percent for the week of march. [SEP] "i just want to see," he said. [SEP] this needs to be true. [SEP] " so much luck, but the same kind of commitment..... [SEP] at the end of october, you talk again, and not before we, not americans, can look forward, we get it back. [SEP] it was clear that the [SEP] + +===== sample 043 ===== +[CLS], "he said at the end of his speech. [SEP] too many of them, the very end to them, have gone very well in the past. [SEP] the ministry spokesman declined to comment. [SEP]" written in black, full of powder, on the face of someone on the back. [SEP] so, yeah - - now, walk back to the oval office, and again, a few minutes ahead of the time. [SEP] i was trying to say "i try to pull that off - i'll do that," he said. [SEP] i've lost that resolve, "he said. [SEP]" i'm glad [SEP] + +===== sample 044 ===== +[CLS] have to eat..... [SEP] there is still the real history of the citycentre - - david johnson, the chief executive, wrote a note to the city to name it 1868 - - and then, he would come back to the building. [SEP] "i would, trying to get over it, get to it - - the road to play, the normal road to travel, to travel," he said. [SEP] " they don't really do anything, they've got to do everything. [SEP] that, he said, continues as the character gets to his side. [SEP] the problem was too simple. [SEP] + +===== sample 045 ===== +[CLS] of their own. [SEP] but, it turns out, they own it. [SEP] marston, 39, admitted he was driving and was taken back to life three days after the 13 - year - old died. [SEP] he also said that he will have to have a further period in the next few months to get a job on a different basis. [SEP] so the idea of having a baby, whether in the sink, or with the baby, may be a sign of social tension, he said. [SEP] the policy was introduced in the late 1970s, but, later, back to the 1980s. [SEP] he was taken to the royal infirmary [SEP] + +===== sample 046 ===== +[CLS], 2007. [SEP] the story seemed to be long and true, but ultimately, not true. [SEP] the mulls are always cool.... so they are strong in winter - - usually in days b, b, a, b, a and a. [SEP] he also died about 15 minutes before being killed. [SEP] in the moment, five minutes after the flight began the flight, we sat on the front, right up to the end of the flight, but then we took a look down the air. [SEP] it had been november, december, 2004, and 2004. [SEP] you just get that series 2 - 2. [SEP] + +===== sample 047 ===== +[CLS] the study found. [SEP] i think they think, they know, they realize that there's so much they do to understand into us now, they're kind of doing that sort of stupid thing, they will get to put things in their mouths. [SEP] so since i was moved,, well, i've been in,,,,,, half, half, half, half - i still have a,,, half, half, half, maybe, half, half, half, half, half,. [SEP] and they didn't do any of them. [SEP] but in the hotel room, a policeman [SEP] + +===== sample 048 ===== +[CLS] [SEP] if you're not sure how to drive as a person, what's more, especially with the car attached, so you can sit down again, need to feel and feel a bit backward, so you need to get ready to do it, get the focus and come back from the car while the person just goes, and grind it up. [SEP] the court had heard that the alleged incidents took place between now and last november. [SEP] in addition, these businesses will make glues, gels, chemicals to make plastics, such as glues, used in the bottom layers of steel wheels. [SEP] a review of a [SEP] + +===== sample 049 ===== +[CLS] to make this work, "he concluded. [SEP] if cubans don't have the cash to raise and pay taxes. [SEP] that wasn't. [SEP] and i would love you to get to a real career. [SEP] the website is available: http://www. aai. nhs. nhs. co. uk. 08. 0844, 607651, including details of address. [SEP]" we heard 4, 075 in october, " it said. [SEP] the spartans came back in the first quarter, and they did not seem to be there, i was just glad. [SEP] a couple of weeks [SEP] + +===== sample 050 ===== +[CLS] along with two other children. [SEP] he said that once the roof collapsed, the size of a pyramid, over the wall of the convoy of police trucks had been set in for vehicles around the site around the building. [SEP] the two have various personal relations to date, over a range of weeks and years, he said. [SEP] we do not need to be together, and have a little luck, to be able to eat together, day, in days, in day, days, days, days, and days, and days, " mr. caer said. [SEP] he started at the same. [SEP] well, i understand. [SEP] + +===== sample 051 ===== +[CLS] in 27 countries, according to an independent survey. [SEP] i often wanted a race for a few days, so i thought about doing one in the early days, but it was like a few days. [SEP] the story will have gone in the air, though, again, with the light of the sun in the sun. [SEP] he didn't have to bother either. [SEP] he's not sure when he's in the room, but the quality of when the lights are there is really important. [SEP] " there is no chance that they will settle - - either in the capital or in the name of peace. [SEP] he [SEP] + +===== sample 052 ===== +[CLS], have to be normal, we have to be able to work... [SEP] the reality now is that the dusty is over at best, not the worst, he said. [SEP] i feel, in the course of days, maybe, you should be able to say, "yes", "not no." [SEP] again, i know, there's a sign of a good relationship, down to a point, but the one, you know, where she manages to look out of herself. [SEP] hundreds of soldiers, deployed around the control point, were able to drive the ship out of the harbor, from a [SEP] + +===== sample 053 ===== +[CLS] - 3 - d' 90s. [SEP] you have to get up in the office, in the situation room, have a good look for a new president. [SEP] nowitzki also had assists in chicago and chicago. [SEP] there are other things to make the same decision, but maybe it is me, "he said. [SEP] i think that people have something to celebrate. [SEP] don't want to go to work unless you get a bad day... [SEP] the incident happened there at 2100 gmt on thursday. [SEP]" so there would have to be a christmas match that would come at around hour, " said mike [SEP] + +===== sample 054 ===== +[CLS] eight years in power. [SEP] it's a joke, a joke, everything. [SEP] the fact that the artist has never spoken is so important, however, that this is just the actual meaning given to the new era of poetry and, she says, a direct testament to the historical connection to the process. [SEP] "i think there is something good," says mr. kiosk, who is in the age of 68. [SEP] " now it has to wait three years for something. [SEP] he had been on the last day of the attack. [SEP] it was short, dark, paler and dark gray. [SEP] however, [SEP] + +===== sample 055 ===== +[CLS] the league start. [SEP] the union's meeting is to take the walk - off in preparation for the completion of the site. [SEP] no..... we buy all those products. [SEP] the court is expected to hear a number of civil rights cases. [SEP] it's a situation. [SEP] the larger point is that their work is likely to be more complex. [SEP] "to the right now, that is ridiculous," he said. [SEP] cook in the oven for hundreds of minutes. [SEP] a lot of things have come down, we've been through a lot of mistakes. [SEP] a bank of england in the [SEP] + +===== sample 056 ===== +[CLS], unable to get in a day out. [SEP] he said the figure would have been increased to £3. 3m. [SEP] the answer is not clear, so give you a something - in - a - mouth.... [SEP] instead, the station will move clockwise, just on the roof, on the outer side, and in the face of the full - side roof, with a full - side effect on the roof. [SEP] that roll call came at noon on friday, just days before the poll results showed up. [SEP] "the tsa has a better sense of ability to handle security and security issues," said bob [SEP] + +===== sample 057 ===== +[CLS] to take the loan. [SEP] a couple of hours after the break, at least, as the truck creeps, he swaggers the end of the show, warming up to back - to - back performances. [SEP] that was a reality early in the series. [SEP] "i do feel lucky. [SEP] everything i have remember has never been true. [SEP] there was a chance for me to get into something - - to get a little better, to get a little better, and get more in shape. [SEP]" there, i got a call, and then, i came back - - - but i stayed because i thought i [SEP] + +===== sample 058 ===== +[CLS] don't have to pay to get in care, but we know, we could not cover it. [SEP] it was a draw. [SEP] this time, he's off to stay a little longer, so i'm delighted. [SEP] we asked if, with the kids, we wanted to get back on, and maybe even. [SEP] the moment, zeger said, he was unable to get out of his home in the back of a car, even though he did not die. [SEP] 70, 73 - 70, 73 - 80, 73,,,,,,,,,,,,,,,, [SEP] + +===== sample 059 ===== +[CLS] "i'm not sure i have the type of quality and that i have to make a strong commitment to the club. [SEP] in that process comes the talk of his" impact "memoir, in which he loses his power and seems to keep on his feet. [SEP]" i urge the leaders... to move carefully and believe that the u. s. needs to be able to resolve problems in pakistan, " she said. [SEP] i know you also have to cover things. [SEP] unemployment, which rose in december, rose by 1. 3m in december from a year ago for the first full year, which began to [SEP] + +===== sample 060 ===== +[CLS] presence in the audience, especially in black, but it is not confirmed. [SEP] just how much difference is there really when a person turns into the air rage? [SEP] since a snow - days, period, period, and days, the winter period in the ice there has been a full period in the cold water, a full days, days, from day to day in the sun, to the arctic circle, then days, back to the water, ice in the afternoon, ice in the day, the ice in a deep place in the snow. [SEP] so i had to start three days later. [SEP] however, it seems to [SEP] + +===== sample 061 ===== +[CLS] was, briefly, a "fresh dog" in a freezer, so i could take the walk. [SEP] at the end of the day, then, he seems to have won. [SEP] he said the monthly fees might have been a temporary fact, since he had less time to invest in his work but would have to give him more money, or he wanted to buy more goods. [SEP] an additional 1, 200 jobs were on the private payroll in january, down from 42, 000 in december 2006, and up 4 percent from the year before. [SEP] denver, detroit, boston 90, chicago, chicago, chicago 80, cleveland [SEP] + +===== sample 062 ===== +[CLS] of poverty, is one of the problems, he says. [SEP] i do now have to say in person what things have to get done at the same time. [SEP] i was on the plane, and yes, everyone has to do anything, so the travel chaos was so much that i wanted to go there and then i wanted to have a flight. [SEP] of course, then, then, yes, what has to be done. [SEP] what a do, for you,,,,,,,,,,,,,,,,,,,,,,,. [SEP] the career leader, a 13 - year [SEP] + +===== sample 063 ===== +[CLS] said. [SEP] "when someone has arrived i have to keep a sense of perspective on all the places. [SEP] the technical problems were a problem for the colts. [SEP] the rangers moved into the spot with a 1 - 3 record, and a 17 - point lead with detroit and new york in the al east. [SEP] and, it said, the companies must have the flexibility to manage their budgets when they want to make big money. [SEP]" we have asked what the outcome of the problem is, and we want to address it. [SEP] the problem is that well into next year's disastrous presidential election - - a period when mr [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/state_c1024_t1p45_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/state_c1024_t1p45_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..9572e82cf2506b34208f7e220e081834b6421fb3 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/state_c1024_t1p45_raw_samples.txt @@ -0,0 +1,228 @@ +state_c1024_t1p45 +{ + "type": "summary", + "name": "state_c1024_t1p45", + "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", + "step": 124000, + "decode": { + "kind": "categorical_fullvocab", + "config": "state_c1024_t1p45", + "steps": 64, + "model_t_mode": "post", + "support_power": 1.0, + "semantic_power": 1.0, + "endpoint_temp": 1.45, + "concentration_min": 1.0, + "concentration_max": 1024.0, + "final_from": "state", + "update": "resample", + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 35.36294023649359, + "nll_per_token": 3.565664385797097, + "tokens": 9515 + }, + "diversity": { + "sample_entropy": 3.884623591993139, + "unique_tokens": 1443, + "token_count": 8192, + "distinct_1": 0.1761474609375, + "distinct_2": 0.5751722440944882, + "top_token_mass": 0.1007080078125 + } +} + +===== sample 000 ===== +[CLS], 2003, when the woman failed to meet in the afghanistan - pakistan border area, police said. [SEP] he doesn ' t mind a car, his father doesn ' t like being a cat or dog, so he can cope with the strain of being a dog. [SEP] ( at least ) now i have learned about the special qualities that make me sweat. [SEP] and sometimes he ' s too angry - - just to austere his way. [SEP] " i think we all need to get to that place and know it ' s what we really want, " he said. [SEP] so i didn ' t just want to see the [SEP] + +===== sample 001 ===== +[CLS], and it failed to come up without an effect to the law. [SEP] i ' ll have much work to do, get to get a job, get back in the house. [SEP] the woman has been told : " i don ' t want you to walk on an airplane. [SEP] " he spent his days, days, a week, and then days a week, the days, days to stay, days to get back to, end, the time of days, days, the time to work days, the time to work, and finally to be together, " al - ha, according to the magazine. [SEP] he, [SEP] + +===== sample 002 ===== +[CLS] said. [SEP] but the show prides itself, too, in the appearance of a good program, which ends with a lot to do. [SEP] mike brown had 13 points and four assists in a season - high victory to give the thunder the halftime lead. [SEP] after watching the first - round games with the jets, two games in the next two games, the two games of the games, and then the jets of the games, buffalo has to get to detroit, win the game, game - to - game, and get to victory. [SEP] however, i ' m confident of their support. [SEP] there is also no shortage of [SEP] + +===== sample 003 ===== +[CLS] oh,, well, it was a little harder, at the moment - and, well, it was like a little bit of a joke. [SEP] i still recommend it for you, but there ' s a bed, spa, a door, a coffee bar, a chair so you can ' t sign for a tree. [SEP] and we have to watch on that situation. [SEP] the man who stands up and talks with his wife said, once again, i ' m beginning to realize that he is getting ready to do it. [SEP] the marlins, losing for the first time in their third game, are in a series of four [SEP] + +===== sample 004 ===== +[CLS]. s. stores in parts of washington, chicago, new york, denver and chicago. [SEP] after all, i do not want to talk about it. [SEP] " i don ' t think of anything to show a decline of 50. 3 %. [SEP] the american government has already shown that i don ' t want a political leader to make a pledge to speak up to our soldiers in iraq and the american people have to put them to work with the troops and people of afghanistan. [SEP] no, the picture ends with the lights, the yellow shirts, hands with the colors, a black mask - -... [SEP] to read [SEP] + +===== sample 005 ===== +[CLS] hard to believe. [SEP] i ' m sorry, and you want me to do that, and i do it anyway. [SEP] " you get to work a hard, yeah, i get to work, " she said, " yes. " [SEP] and, yeah, oh, yeah, and maybe in the top 20. [SEP] the contrast is found, in the middle, the one - sided side, in the top, and in the other half of the top. [SEP] and so, if they are going to get in trouble, there ' s still room for some improvement. [SEP] then, though, they were all about, what [SEP] + +===== sample 006 ===== +[CLS] the country. [SEP] of course, it isn ' t enough to be a hit, to replace the iphone with the pay - off - - and to cut it back further - - until the next time. [SEP] while i think that relationship will be better, i ' ve been wrong, maybe, nothing. [SEP] for the past 20 years, years, days,, weeks, years, and months, for us to come back on the road, and then again, maybe, again... and then we get back in a bad spiral, and we have managed to get down to a halt. [SEP] the campaign also has a [SEP] + +===== sample 007 ===== +[CLS] said. [SEP] but, there must be a national government trying to eliminate the divide between muslims and republicans. [SEP] " thousands of iranians have never been to democracy because they have been engaged to peaceful demonstrations and are involved in making a political deal. [SEP] the latest difference to history is that the jets are on offense at the end of the season. [SEP] the answer is not for the ultimate reason, but the answer itself. [SEP] " the world series is getting us back in the world and lord ' s is ok, that ' s ok... [SEP] the audience had an emotional capacity to admit - - even to admit - - [SEP] + +===== sample 008 ===== +[CLS] years after israel ' s capture. [SEP] i think the whole thing is just, well, very good. [SEP] i think it ' s going to change a lot to that. [SEP] it ' s time the audience refuses to reflect on the foundation of a creator. [SEP] everything from long shorts, leather pants, silk shirts, raincoats, cut - back jackets and hood - covered tops, grey - banded vests, copper - colored shirts, black suspenders - and - tops. [SEP] sub - prime securities, the firm, was involved in the swap, which saw each of the 500 vehicles on a debt list. [SEP] what [SEP] + +===== sample 009 ===== +[CLS], that it would consider limiting voting rights for the funds. [SEP] he had the ability to talk, to talk, to talk, not even speak. [SEP] she opens the door in search of assistance. [SEP] if you can move back and move back alone, the employer would not put you back to work again. [SEP] in return, add together the butter and add a little vanilla. [SEP] about a dozen other items - - bundles of plastic, plastic, furniture and aluminum - - have gone out of circulation since 2002. [SEP] the authorities have put a similar case behind hold in the uk. [SEP] " for a certain number of our customers [SEP] + +===== sample 010 ===== +[CLS] anti - related, the federal food and drug administration said on tuesday. [SEP] ap news ' jim scirillo in mexico city and glen johnson in washington contributed to this report. [SEP] but he did not address any need for donations. [SEP] in addition to requests for comment from european authorities, the u. s. embassy declined to return phone calls to the associated press for any further comment on tuesday. [SEP] he wanted them to be on the offensive line. [SEP] " i don ' t think that we would get much rest anytime soon, " said gordon brown, the chairman of the american asset management association. [SEP] the other side, to [SEP] + +===== sample 011 ===== +[CLS] finally showed up. [SEP] " it ' s going to be an opportunity to have one of us give you all the money. [SEP] i ' m glad a nice, red - haired person who needs to get your family together wants to give you something, such as taking them up for a car, a bed and a room. [SEP] the mental health team examined the results of a forensic examination and the backgrounds of the suspects. [SEP] 104. 85, 84, 104, 84, 98 - 113.... [SEP] the carrier - - airlines - - can operate thousands of flights to the entire united states. [SEP] with the exception of [SEP] + +===== sample 012 ===== +[CLS] - 30 % higher than in 2007. [SEP] at the other end of 2 a. m., then 8, 8, 9, 11, 11, 15, and 10, 16, and 18, to get 4, 5, 4, 4, 6, 6, and back on time. [SEP] i stepped into her car and it had been a while, and she needed to do, " he said. [SEP] and if you do, a good person in the world will have a place to go or to do a job. [SEP] " i really think he deserves to be in the race, " said ridley - thomas, [SEP] + +===== sample 013 ===== +[CLS], he said. [SEP] he winced, hugged, the crowd froze, and exhaled. [SEP] but, there do appear to be some problems : " i found the mattress in, on occasion, the passenger drawer. " [SEP] as a result, he comes out and he says, " yeah, he has a lot to do. [SEP] i ' m not sure until the lights come out and,,,,,,, all the time, don ' t know, what,,,, what,,, what, what,. [SEP] the industry, flush with money, has run out of cars, planes, cars and planes [SEP] + +===== sample 014 ===== +[CLS]. [SEP] but for a long time, it has to be taken with, he said, " a great effect. " [SEP] the project is also a private investment, as part of the sale to the bank of scotland. [SEP] for now, everyone are able to get their names together - - 2, 3, 14,, 8, 12, 11, 13, a word. [SEP] i think so well. [SEP] " i wanted him to talk to him, " she added. [SEP] " i continue to love him for all, " he said. [SEP] but if there is anything to go by, it doesn ' t work. [SEP] + +===== sample 015 ===== +[CLS] " she said. [SEP] so much so i spent my days trying to get back to the house - i would drink in transit, i would never die in a tunnel on a bus - and it came along, so far, so quickly, just because it would stop, and then, then later, off the road. [SEP] then, every day, i mean, 49, 37, 50, i usually have 200, 200, 50, 50, 60 days. [SEP] on a short voyage, the aircraft carried aircraft, planes and equipment to the roof of the united nation ' s fueling system. [SEP] i agree with your assertion [SEP] + +===== sample 016 ===== +[CLS] happens on wall, say, rather, newspapers, it is no reflection of their diversity. [SEP] the story doesn ' t seem to work out the only way of finding a way to feel bad news. [SEP] we started with a computer, two minutes, a few minutes, looking at the hotel ' s small door, looking in its yard. [SEP] a 45 - year - old french student who says she wrote her boyfriend ' s name is on the stand, a court heard. [SEP] i have been in the field since the age of 17, but i never had one. [SEP] but i just think that with the obvious problems, there [SEP] + +===== sample 017 ===== +[CLS] investors, would seem to include the idea of a short - term buy - out. [SEP] what makes an even greater problem, the truth, is a combination of - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -. [SEP] but it ' s not a time to start and tell us to look here. [SEP] the 21 - year - old midfielder moved to liverpool from the club in 2006. [SEP] the house, kupech said, is expected to be a 300 - foot vehicle with a top speed of 40 miles [SEP] + +===== sample 018 ===== +[CLS] not have the opportunity to speak unless i have to listen to read the novel. [SEP] london ( ap ) - british transport officials have launched a " demonstration " operation over the refusal of european union airspace to allow flights to the hubble and a lack of extra transport flights so the mission can expand beyond the end of the full year. [SEP] police are keen to speak to four men, including the father of a baby, who walked in the heart of york street, eastbourne, at 0115 gmt on saturday. [SEP] by the way, fluorescent lights, candles, rubbers and candles come together, shoes, pillows, etc. [SEP] + +===== sample 019 ===== +[CLS] said. [SEP] they may have a good future in self - esteem and we have had to question the trust of children at the end of their lives. [SEP] i like the sparkle of light, i can see from the top windows, the sparkle of the ceiling, the sparkle of lights. [SEP] the bill also includes the use of emergency planes, the use of cargo planes, cargo planes, the use of passenger planes, aircraft and automobiles. [SEP] if to make it for a two - win race against the best team in the world, we are just right to keep on making the most of the game. [SEP] here, it seems, [SEP] + +===== sample 020 ===== +[CLS] " he said. [SEP] when hillary clinton told the crowd that she wanted to make " a fateful ( inky ) gesture out of her mouth, " my name was raised. [SEP] his coats of black tops and dark white shoes, all clouds white, a long black scarf, a black white hat, and a large - looking black top - - faded and then, again, then we all have to wait and then half,, then half,, half,, the carpet is on. [SEP] the uk ' s foreign minister said in a statement released on monday that it was a " significant priority " for efforts to resolve the [SEP] + +===== sample 021 ===== +[CLS]. [SEP] " it was a guy on the other side of a line, saying..., kind of " shit, wack, " he said... [SEP] there is a lot of space in all of our minds, that need to think how our lives have changed, " he said a while earlier. [SEP] a bit of art, that seems to me, comes with an arm and a lot of empty mind. [SEP] " it is a law they must change, because it is so, " he said. [SEP] the teen, hamilton of michigan, was arrested in a separate area just days outside his home on a [SEP] + +===== sample 022 ===== +[CLS] to be completed in one to two days. [SEP] the government statement said the school would return by december, beginning in 2014. [SEP] overby said she is concerned about the concept behind that decision when she wants to get the job done and vote for it. [SEP] some are very hard, some funky, some making it up and just trying to make a bit more than a bit bland and sweet. [SEP] chicago ( reuters ) - trade leaders, meeting in chicago hoping to boost trade between the u. s. and africa, will meet in a bid to forge a balance on trade, a senior official said on monday. [SEP] the company [SEP] + +===== sample 023 ===== +[CLS], the company has said it will not reveal what they are thinking about. [SEP] " unfortunately at the moment, many of us have no access to public funding, and refuse to work to deal with the enormous issues. [SEP] he never gets a chance to start, just to start in the locker room. [SEP] a small seating area has been set up inside, and large spaces in the area. [SEP] " it ' s like he ' s driving, going down in the road, going back on the street at work, going on to back, but going back - in - the - road, down the road, up there. [SEP] [SEP] + +===== sample 024 ===== +[CLS] in 2001. [SEP] the farmers, he said, will not do it until 2017, and then will make ends meet in season to season, with the current peaking at a peak of around 50c in two years. [SEP] with the lights of miami, the story turned green, green, black and green, and the dust of black faded in the wind and the stone pillars of the wall again faded. [SEP] the officials, speaking condition of anonymity, agreed that obama ' s withdrawal would continue until the end of the year. [SEP] no, i try to tell you the author may just be a 300 - a - word, [SEP] + +===== sample 025 ===== +[CLS] unusual, however, at this time. [SEP] people wanted to wake up to understand the situation, " said to the student, who said the noise was " fantastic " and then he got back on the ground. [SEP] i mean sorry, but then you, god, take a day for a tea, some for a pill, men and women. [SEP] " anything that will happen within the term - - when it is half a century - - will be much harder to prepare for, " he said. [SEP] the teams spent about four days a week trying to bring the best of the best of the nba chicago, june 30 ( up [SEP] + +===== sample 026 ===== +[CLS] they started to sing, they began laughing, " she said. [SEP] and, i can ' t understand how, for now, people are willing to drop their wallets and put their noses in the door. [SEP] the family then wanted to get a question - and - answer to where he was going, he said. [SEP] " here, the game has not come to a close. [SEP] now that the economy is back to the boom - and - bust cycles, and the process continues, the idea that everything is going in a little bit and moving is we have to wait and get a little longer. [SEP] he began with a [SEP] + +===== sample 027 ===== +[CLS] his plan, and he ruled out it would do something to some of his clients. [SEP] but a few weeks, for me, and for the fans, it has been the time for me to fight, " he said. [SEP] after a restoration, the final part of the houseboard section of the building, confined to the ceiling railings, returns to the edge of darkness. [SEP] this requirement has been put in one place. [SEP] at least 100 french soldiers have been killed. [SEP] and when i do, i take off, i feel the smell of music in my face. [SEP] he struggles with the breadth of his collection. [SEP] + +===== sample 028 ===== +[CLS] meeting in baghdad, the official told reporters. [SEP] they were the real problem and they were all on their own. [SEP] " i remember him was once standing on the other side of the room, and with him, he said, come back, look up, he said goodbye, and then he said to me, and he said yes, he was another. [SEP] and, oh, uh - oh, there ' s a lot. [SEP] only a few of the drugs were used in britain to treat serious kidney problems. [SEP] so, then, are the bigger problems. [SEP] " people don ' t wait for answers. [SEP] " [SEP] + +===== sample 029 ===== +[CLS] said. [SEP] the result of our investigation is that the internet is a priority. [SEP] i think the children will find themselves sitting in disbelief, if they are to turn around. [SEP] the financial collapse of the credit crunch, many of its names were being announced, appears to have engulfed some of the world ' s most susceptic economies. [SEP] even when it gets done, that kind of person eats up a hair and refuses to come. [SEP] and the message was clear that, with the end of the olympics in sight, i didn ' t have a sense of humor, or even the thrill of getting in a field. [SEP] + +===== sample 030 ===== +[CLS] couple of hours, i would not be able to get the full flight, he said. [SEP] but he knew, and he refused to speak. [SEP] we do not like the things that the person at the top, at a corner, at the top, at the top line, the body, to the top, the bottom line, up to the top. [SEP] while the emotional nature of the story, in which the story is taken by the author ' s son on a huge canvas, has settled the issue, the narrative of moyesque is far deeper than ever. [SEP] so, if i only get through the house, [SEP] + +===== sample 031 ===== +[CLS]. [SEP] the hospital has a great room and is a very nice room, a great group, " he said. [SEP] when everyone talks about him and his accomplishments, i will wonder if they are anything more, just temporary. [SEP] 7, detroit, calgary - toronto 11 - 13, detroit - boston 16, detroit - chicago, detroit - chicago, in place of chicago, detroit - denver. [SEP] more than 30 aircraft, including 13 men, women and one - third of the staff, were scheduled to leave in coming days, the coalition said. [SEP] 5 to serve as head of the special forces command. [SEP] the article appeared [SEP] + +===== sample 032 ===== +[CLS] [SEP] that is what is a situation not changed since the end of the 1970s. [SEP] the only way to do, say, say, say, say, look, it ' s a matter of working the hard, with little problem, trying to get the word ' turn ' right. [SEP] yes, however, the distinction is important. [SEP] he just started in chicago, detroit, denver, chicago, before going to the airport. [SEP] but, time is on the line, there are days to be had, now, and then, and, finally, with the chance to become, again, a half - day. [SEP] the [SEP] + +===== sample 033 ===== +[CLS] the girl, a 6 - year - old little girl. [SEP] the baby is ½ - and - 1 - - tucked up in dark pajamas, working in suitcases, bunks, and in pantsuits, in dark pants. [SEP] meanwhile, these researchers are also parachuted in to work with special equipment to deliver these additional multi - wheeled units - - including lifts, lifts, wheelchairs, lifts and - - on support of emc technology. [SEP] canada. [SEP] the plane, £1, 095 ( £11, 772 ), has seven flights. [SEP] " it ' s like we ' re not talking. [SEP] + +===== sample 034 ===== +[CLS] chicago in chicago, chicago - to tampa, detroit, and - detroit in cleveland. [SEP] i just think he is going to step down if he doesn ' t plan to return. [SEP] it ' s 60, 50,, 50, 60, - - 50, 50 - - 50, 38, 36, 48 days. [SEP] brown had 16 points and nine rebounds, including a point game, a trip to the blue devils, and even a game in the second period. [SEP] 9, chicago 17, new jersey 18. [SEP] he refused to give his students of dollars and even told them to check in. [SEP] the court heard [SEP] + +===== sample 035 ===== +[CLS] said. [SEP] a lovely, fruit - scented version of wilt vanilla, with a paler shade of lemon flavors. [SEP] chicago is 7 - 4 with a 2 - 2 - 2 era. [SEP] it ' s quite a bit to learn. [SEP] " he ' s really so clever, he moved quickly through his acting period, and got into a place where he huffed and puffed and rolled up his teeth, opened his eyes. " [SEP] there are people who have other types of financial support. [SEP] " the victory will have a huge impact, " analysts say, for the fast - growing insurgency. [SEP] i never believe that a [SEP] + +===== sample 036 ===== +[CLS] began in january 2005. [SEP] other cities have made significant gains, including london, in london, and in the midlands, for the last five years. [SEP] " i think i ' d just like to sleep, but when it is good, you get to sleep, not well, " he said. [SEP] the next day, however, she is asleep in the next room, but the answer begins to appear, she ' s looking up and laughing. [SEP] " i don ' t think he is going to talk. [SEP] i have white shirts, white shirts, blackcoats and gray black shirts. [SEP] the complete collapse of american [SEP] + +===== sample 037 ===== +[CLS] pakistan, comes close to a solution, obama said. [SEP] he walked off in frustration and worked out side - by - side for the second time in a career - long year - - a tie with the series he began in march 2000. [SEP] but overall, the rebels did have a full advantage - - or even, perhaps - - and managed to move inside. [SEP] it may not have to work. [SEP] the aircraft also caters to 1, 200 britons, which are worth 2. 7 million tonnes - - on orders from the government - to the airport. [SEP] the company, which includes 37 airlines and cargo companies, [SEP] + +===== sample 038 ===== +[CLS] [SEP] " so it is about everyone, " mr. he said. [SEP] bring out a good plan to try to keep up with the real economy. [SEP] you know, the big vampires, the elves, the elves. [SEP] we came up, dancing, the stars, that was good, but then i started, and i was really angry, " he said. [SEP] " to see that to him, he knows what ' s important. [SEP] israel said it would not want to return and that it would return to hamas. [SEP] at the end of the four - game day, angels starter derek matsui went back with an rbi [SEP] + +===== sample 039 ===== +[CLS] said. [SEP] but when a three - wheeled bus pulled me around, he pulled me into a corner, and pulled me into a corner. [SEP] well, so it was a great game for us. [SEP] foreign flights have been on strike over the past week, with security concerns that could also affect domestic flights. [SEP] we focus on baking, baking, baking, baking, baking, baking, baking, milk, baking, baking, tomato, mint. [SEP] if he ' s 21 years old, so i ' m guessing, you just want him to keep working, you never look back again, he ' s ok, so where [SEP] + +===== sample 040 ===== +[CLS]. [SEP] in november 2002, he wrote down the bill and tried to amend the legislation. [SEP] the problem not for the jets, but for the fans and the club. [SEP] i think, from the beginning, to the end, just to the finish line. [SEP] the way the researchers are trying to point out, the problem is real. [SEP] i don ' t know that we have to do that, " he said. [SEP] look at the details, and then you would get me right, and then i imagine that in the case of a race, i would go - - literally - - from the end of the line. [SEP] + +===== sample 041 ===== +[CLS] s a great way to get together, i plan to spend the week in the light of my surroundings, " he said. [SEP] no one at the stadium went on holiday, we didn ' t know it would be back anyway. [SEP] the idea is to be able to get into something and something new, going right out of the hands of a soldier and getting out of it. [SEP] oh, oh, oh, so much gratitude, and, oh, yes, oh, i love and i love, the last thing it is to remember,,,, so much,,,,,, so much. [SEP] he was [SEP] + +===== sample 042 ===== +[CLS] in particular, but not in my personal case, they have a little smile on their faces. [SEP] for the week, the error was only about 50 %, up from 60 percent for the previous week, again in october 2008, and to 45 percent for the week of march. [SEP] " i just want to see, " he said. [SEP] this needs to be true. [SEP] " so much luck, but the same kind of commitment..... [SEP] at the end of october, you talk again, and not before we, not americans, can look forward, we get it back. [SEP] it was clear that the [SEP] + +===== sample 043 ===== +[CLS], " he said at the end of his speech. [SEP] too many of them, the very end to them, have gone very well in the past. [SEP] the ministry spokesman declined to comment. [SEP] " written in black, full of powder, on the face of someone on the back. [SEP] so, yeah - - now, walk back to the oval office, and again, a few minutes ahead of the time. [SEP] i was trying to say " i try to pull that off - i ' ll do that, " he said. [SEP] i ' ve lost that resolve, " he said. [SEP] " i ' m glad [SEP] + +===== sample 044 ===== +[CLS] have to eat..... [SEP] there is still the real history of the citycentre - - david johnson, the chief executive, wrote a note to the city to name it 1868 - - and then, he would come back to the building. [SEP] " i would, trying to get over it, get to it - - the road to play, the normal road to travel, to travel, " he said. [SEP] " they don ' t really do anything, they ' ve got to do everything. [SEP] that, he said, continues as the character gets to his side. [SEP] the problem was too simple. [SEP] + +===== sample 045 ===== +[CLS] of their own. [SEP] but, it turns out, they own it. [SEP] marston, 39, admitted he was driving and was taken back to life three days after the 13 - year - old died. [SEP] he also said that he will have to have a further period in the next few months to get a job on a different basis. [SEP] so the idea of having a baby, whether in the sink, or with the baby, may be a sign of social tension, he said. [SEP] the policy was introduced in the late 1970s, but, later, back to the 1980s. [SEP] he was taken to the royal infirmary [SEP] + +===== sample 046 ===== +[CLS], 2007. [SEP] the story seemed to be long and true, but ultimately, not true. [SEP] the mulls are always cool.... so they are strong in winter - - usually in days b, b, a, b, a and a. [SEP] he also died about 15 minutes before being killed. [SEP] in the moment, five minutes after the flight began the flight, we sat on the front, right up to the end of the flight, but then we took a look down the air. [SEP] it had been november, december, 2004, and 2004. [SEP] you just get that series 2 - 2. [SEP] + +===== sample 047 ===== +[CLS] the study found. [SEP] i think they think, they know, they realize that there ' s so much they do to understand into us now, they ' re kind of doing that sort of stupid thing, they will get to put things in their mouths. [SEP] so since i was moved,, well, i ' ve been in,,,,,, half, half, half, half - i still have a,,, half, half, half, maybe, half, half, half, half, half,. [SEP] and they didn ' t do any of them. [SEP] but in the hotel room, a policeman [SEP] + +===== sample 048 ===== +[CLS] [SEP] if you ' re not sure how to drive as a person, what ' s more, especially with the car attached, so you can sit down again, need to feel and feel a bit backward, so you need to get ready to do it, get the focus and come back from the car while the person just goes, and grind it up. [SEP] the court had heard that the alleged incidents took place between now and last november. [SEP] in addition, these businesses will make glues, gels, chemicals to make plastics, such as glues, used in the bottom layers of steel wheels. [SEP] a review of a [SEP] + +===== sample 049 ===== +[CLS] to make this work, " he concluded. [SEP] if cubans don ' t have the cash to raise and pay taxes. [SEP] that wasn ' t. [SEP] and i would love you to get to a real career. [SEP] the website is available : http : / / www. aai. nhs. nhs. co. uk. 08. 0844, 607651, including details of address. [SEP] " we heard 4, 075 in october, " it said. [SEP] the spartans came back in the first quarter, and they did not seem to be there, i was just glad. [SEP] a couple of weeks [SEP] + +===== sample 050 ===== +[CLS] along with two other children. [SEP] he said that once the roof collapsed, the size of a pyramid, over the wall of the convoy of police trucks had been set in for vehicles around the site around the building. [SEP] the two have various personal relations to date, over a range of weeks and years, he said. [SEP] we do not need to be together, and have a little luck, to be able to eat together, day, in days, in day, days, days, days, and days, and days, " mr. caer said. [SEP] he started at the same. [SEP] well, i understand. [SEP] + +===== sample 051 ===== +[CLS] in 27 countries, according to an independent survey. [SEP] i often wanted a race for a few days, so i thought about doing one in the early days, but it was like a few days. [SEP] the story will have gone in the air, though, again, with the light of the sun in the sun. [SEP] he didn ' t have to bother either. [SEP] he ' s not sure when he ' s in the room, but the quality of when the lights are there is really important. [SEP] " there is no chance that they will settle - - either in the capital or in the name of peace. [SEP] he [SEP] + +===== sample 052 ===== +[CLS], have to be normal, we have to be able to work... [SEP] the reality now is that the dusty is over at best, not the worst, he said. [SEP] i feel, in the course of days, maybe, you should be able to say, " yes ", " not no. " [SEP] again, i know, there ' s a sign of a good relationship, down to a point, but the one, you know, where she manages to look out of herself. [SEP] hundreds of soldiers, deployed around the control point, were able to drive the ship out of the harbor, from a [SEP] + +===== sample 053 ===== +[CLS] - 3 - d ' 90s. [SEP] you have to get up in the office, in the situation room, have a good look for a new president. [SEP] nowitzki also had assists in chicago and chicago. [SEP] there are other things to make the same decision, but maybe it is me, " he said. [SEP] i think that people have something to celebrate. [SEP] don ' t want to go to work unless you get a bad day... [SEP] the incident happened there at 2100 gmt on thursday. [SEP] " so there would have to be a christmas match that would come at around hour, " said mike [SEP] + +===== sample 054 ===== +[CLS] eight years in power. [SEP] it ' s a joke, a joke, everything. [SEP] the fact that the artist has never spoken is so important, however, that this is just the actual meaning given to the new era of poetry and, she says, a direct testament to the historical connection to the process. [SEP] " i think there is something good, " says mr. kiosk, who is in the age of 68. [SEP] " now it has to wait three years for something. [SEP] he had been on the last day of the attack. [SEP] it was short, dark, paler and dark gray. [SEP] however, [SEP] + +===== sample 055 ===== +[CLS] the league start. [SEP] the union ' s meeting is to take the walk - off in preparation for the completion of the site. [SEP] no..... we buy all those products. [SEP] the court is expected to hear a number of civil rights cases. [SEP] it ' s a situation. [SEP] the larger point is that their work is likely to be more complex. [SEP] " to the right now, that is ridiculous, " he said. [SEP] cook in the oven for hundreds of minutes. [SEP] a lot of things have come down, we ' ve been through a lot of mistakes. [SEP] a bank of england in the [SEP] + +===== sample 056 ===== +[CLS], unable to get in a day out. [SEP] he said the figure would have been increased to £3. 3m. [SEP] the answer is not clear, so give you a something - in - a - mouth.... [SEP] instead, the station will move clockwise, just on the roof, on the outer side, and in the face of the full - side roof, with a full - side effect on the roof. [SEP] that roll call came at noon on friday, just days before the poll results showed up. [SEP] " the tsa has a better sense of ability to handle security and security issues, " said bob [SEP] + +===== sample 057 ===== +[CLS] to take the loan. [SEP] a couple of hours after the break, at least, as the truck creeps, he swaggers the end of the show, warming up to back - to - back performances. [SEP] that was a reality early in the series. [SEP] " i do feel lucky. [SEP] everything i have remember has never been true. [SEP] there was a chance for me to get into something - - to get a little better, to get a little better, and get more in shape. [SEP] " there, i got a call, and then, i came back - - - but i stayed because i thought i [SEP] + +===== sample 058 ===== +[CLS] don ' t have to pay to get in care, but we know, we could not cover it. [SEP] it was a draw. [SEP] this time, he ' s off to stay a little longer, so i ' m delighted. [SEP] we asked if, with the kids, we wanted to get back on, and maybe even. [SEP] the moment, zeger said, he was unable to get out of his home in the back of a car, even though he did not die. [SEP] 70, 73 - 70, 73 - 80, 73,,,,,,,,,,,,,,,, [SEP] + +===== sample 059 ===== +[CLS] " i ' m not sure i have the type of quality and that i have to make a strong commitment to the club. [SEP] in that process comes the talk of his " impact " memoir, in which he loses his power and seems to keep on his feet. [SEP] " i urge the leaders... to move carefully and believe that the u. s. needs to be able to resolve problems in pakistan, " she said. [SEP] i know you also have to cover things. [SEP] unemployment, which rose in december, rose by 1. 3m in december from a year ago for the first full year, which began to [SEP] + +===== sample 060 ===== +[CLS] presence in the audience, especially in black, but it is not confirmed. [SEP] just how much difference is there really when a person turns into the air rage? [SEP] since a snow - days, period, period, and days, the winter period in the ice there has been a full period in the cold water, a full days, days, from day to day in the sun, to the arctic circle, then days, back to the water, ice in the afternoon, ice in the day, the ice in a deep place in the snow. [SEP] so i had to start three days later. [SEP] however, it seems to [SEP] + +===== sample 061 ===== +[CLS] was, briefly, a " fresh dog " in a freezer, so i could take the walk. [SEP] at the end of the day, then, he seems to have won. [SEP] he said the monthly fees might have been a temporary fact, since he had less time to invest in his work but would have to give him more money, or he wanted to buy more goods. [SEP] an additional 1, 200 jobs were on the private payroll in january, down from 42, 000 in december 2006, and up 4 percent from the year before. [SEP] denver, detroit, boston 90, chicago, chicago, chicago 80, cleveland [SEP] + +===== sample 062 ===== +[CLS] of poverty, is one of the problems, he says. [SEP] i do now have to say in person what things have to get done at the same time. [SEP] i was on the plane, and yes, everyone has to do anything, so the travel chaos was so much that i wanted to go there and then i wanted to have a flight. [SEP] of course, then, then, yes, what has to be done. [SEP] what a do, for you,,,,,,,,,,,,,,,,,,,,,,,. [SEP] the career leader, a 13 - year [SEP] + +===== sample 063 ===== +[CLS] said. [SEP] " when someone has arrived i have to keep a sense of perspective on all the places. [SEP] the technical problems were a problem for the colts. [SEP] the rangers moved into the spot with a 1 - 3 record, and a 17 - point lead with detroit and new york in the al east. [SEP] and, it said, the companies must have the flexibility to manage their budgets when they want to make big money. [SEP] " we have asked what the outcome of the problem is, and we want to address it. [SEP] the problem is that well into next year ' s disastrous presidential election - - a period when mr [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/state_c1024_t1p45_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/state_c1024_t1p45_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..621447bc104b4bc2854cee9a16a2e615a89f7e7f --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/state_c1024_t1p45_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "state_c1024_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c1024_t1p45", "steps": 64, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 35.36294023649359, "nll_per_token": 3.565664385797097, "tokens": 9515}, "diversity": {"sample_entropy": 3.884623591993139, "unique_tokens": 1443, "token_count": 8192, "distinct_1": 0.1761474609375, "distinct_2": 0.5751722440944882, "top_token_mass": 0.1007080078125}} +{"type": "sample", "index": 0, "raw_text": "[CLS], 2003, when the woman failed to meet in the afghanistan - pakistan border area, police said. [SEP] he doesn ' t mind a car, his father doesn ' t like being a cat or dog, so he can cope with the strain of being a dog. [SEP] ( at least ) now i have learned about the special qualities that make me sweat. [SEP] and sometimes he ' s too angry - - just to austere his way. [SEP] \" i think we all need to get to that place and know it ' s what we really want, \" he said. [SEP] so i didn ' t just want to see the [SEP]", "detok_text": "[CLS], 2003, when the woman failed to meet in the afghanistan - pakistan border area, police said. [SEP] he doesn't mind a car, his father doesn't like being a cat or dog, so he can cope with the strain of being a dog. [SEP] (at least) now i have learned about the special qualities that make me sweat. [SEP] and sometimes he's too angry - - just to austere his way. [SEP] \"i think we all need to get to that place and know it's what we really want,\" he said. [SEP] so i didn't just want to see the [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS], and it failed to come up without an effect to the law. [SEP] i ' ll have much work to do, get to get a job, get back in the house. [SEP] the woman has been told : \" i don ' t want you to walk on an airplane. [SEP] \" he spent his days, days, a week, and then days a week, the days, days to stay, days to get back to, end, the time of days, days, the time to work days, the time to work, and finally to be together, \" al - ha, according to the magazine. [SEP] he, [SEP]", "detok_text": "[CLS], and it failed to come up without an effect to the law. [SEP] i'll have much work to do, get to get a job, get back in the house. [SEP] the woman has been told: \"i don't want you to walk on an airplane. [SEP]\" he spent his days, days, a week, and then days a week, the days, days to stay, days to get back to, end, the time of days, days, the time to work days, the time to work, and finally to be together, \" al - ha, according to the magazine. [SEP] he, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] said. [SEP] but the show prides itself, too, in the appearance of a good program, which ends with a lot to do. [SEP] mike brown had 13 points and four assists in a season - high victory to give the thunder the halftime lead. [SEP] after watching the first - round games with the jets, two games in the next two games, the two games of the games, and then the jets of the games, buffalo has to get to detroit, win the game, game - to - game, and get to victory. [SEP] however, i ' m confident of their support. [SEP] there is also no shortage of [SEP]", "detok_text": "[CLS] said. [SEP] but the show prides itself, too, in the appearance of a good program, which ends with a lot to do. [SEP] mike brown had 13 points and four assists in a season - high victory to give the thunder the halftime lead. [SEP] after watching the first - round games with the jets, two games in the next two games, the two games of the games, and then the jets of the games, buffalo has to get to detroit, win the game, game - to - game, and get to victory. [SEP] however, i'm confident of their support. [SEP] there is also no shortage of [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS] oh,, well, it was a little harder, at the moment - and, well, it was like a little bit of a joke. [SEP] i still recommend it for you, but there ' s a bed, spa, a door, a coffee bar, a chair so you can ' t sign for a tree. [SEP] and we have to watch on that situation. [SEP] the man who stands up and talks with his wife said, once again, i ' m beginning to realize that he is getting ready to do it. [SEP] the marlins, losing for the first time in their third game, are in a series of four [SEP]", "detok_text": "[CLS] oh,, well, it was a little harder, at the moment - and, well, it was like a little bit of a joke. [SEP] i still recommend it for you, but there's a bed, spa, a door, a coffee bar, a chair so you can't sign for a tree. [SEP] and we have to watch on that situation. [SEP] the man who stands up and talks with his wife said, once again, i'm beginning to realize that he is getting ready to do it. [SEP] the marlins, losing for the first time in their third game, are in a series of four [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS]. s. stores in parts of washington, chicago, new york, denver and chicago. [SEP] after all, i do not want to talk about it. [SEP] \" i don ' t think of anything to show a decline of 50. 3 %. [SEP] the american government has already shown that i don ' t want a political leader to make a pledge to speak up to our soldiers in iraq and the american people have to put them to work with the troops and people of afghanistan. [SEP] no, the picture ends with the lights, the yellow shirts, hands with the colors, a black mask - -... [SEP] to read [SEP]", "detok_text": "[CLS]. s. stores in parts of washington, chicago, new york, denver and chicago. [SEP] after all, i do not want to talk about it. [SEP] \" i don't think of anything to show a decline of 50. 3 %. [SEP] the american government has already shown that i don't want a political leader to make a pledge to speak up to our soldiers in iraq and the american people have to put them to work with the troops and people of afghanistan. [SEP] no, the picture ends with the lights, the yellow shirts, hands with the colors, a black mask - -... [SEP] to read [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] hard to believe. [SEP] i ' m sorry, and you want me to do that, and i do it anyway. [SEP] \" you get to work a hard, yeah, i get to work, \" she said, \" yes. \" [SEP] and, yeah, oh, yeah, and maybe in the top 20. [SEP] the contrast is found, in the middle, the one - sided side, in the top, and in the other half of the top. [SEP] and so, if they are going to get in trouble, there ' s still room for some improvement. [SEP] then, though, they were all about, what [SEP]", "detok_text": "[CLS] hard to believe. [SEP] i'm sorry, and you want me to do that, and i do it anyway. [SEP] \"you get to work a hard, yeah, i get to work,\" she said, \"yes.\" [SEP] and, yeah, oh, yeah, and maybe in the top 20. [SEP] the contrast is found, in the middle, the one - sided side, in the top, and in the other half of the top. [SEP] and so, if they are going to get in trouble, there's still room for some improvement. [SEP] then, though, they were all about, what [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] the country. [SEP] of course, it isn ' t enough to be a hit, to replace the iphone with the pay - off - - and to cut it back further - - until the next time. [SEP] while i think that relationship will be better, i ' ve been wrong, maybe, nothing. [SEP] for the past 20 years, years, days,, weeks, years, and months, for us to come back on the road, and then again, maybe, again... and then we get back in a bad spiral, and we have managed to get down to a halt. [SEP] the campaign also has a [SEP]", "detok_text": "[CLS] the country. [SEP] of course, it isn't enough to be a hit, to replace the iphone with the pay - off - - and to cut it back further - - until the next time. [SEP] while i think that relationship will be better, i've been wrong, maybe, nothing. [SEP] for the past 20 years, years, days,, weeks, years, and months, for us to come back on the road, and then again, maybe, again... and then we get back in a bad spiral, and we have managed to get down to a halt. [SEP] the campaign also has a [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] said. [SEP] but, there must be a national government trying to eliminate the divide between muslims and republicans. [SEP] \" thousands of iranians have never been to democracy because they have been engaged to peaceful demonstrations and are involved in making a political deal. [SEP] the latest difference to history is that the jets are on offense at the end of the season. [SEP] the answer is not for the ultimate reason, but the answer itself. [SEP] \" the world series is getting us back in the world and lord ' s is ok, that ' s ok... [SEP] the audience had an emotional capacity to admit - - even to admit - - [SEP]", "detok_text": "[CLS] said. [SEP] but, there must be a national government trying to eliminate the divide between muslims and republicans. [SEP] \"thousands of iranians have never been to democracy because they have been engaged to peaceful demonstrations and are involved in making a political deal. [SEP] the latest difference to history is that the jets are on offense at the end of the season. [SEP] the answer is not for the ultimate reason, but the answer itself. [SEP]\" the world series is getting us back in the world and lord's is ok, that's ok... [SEP] the audience had an emotional capacity to admit - - even to admit - - [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] years after israel ' s capture. [SEP] i think the whole thing is just, well, very good. [SEP] i think it ' s going to change a lot to that. [SEP] it ' s time the audience refuses to reflect on the foundation of a creator. [SEP] everything from long shorts, leather pants, silk shirts, raincoats, cut - back jackets and hood - covered tops, grey - banded vests, copper - colored shirts, black suspenders - and - tops. [SEP] sub - prime securities, the firm, was involved in the swap, which saw each of the 500 vehicles on a debt list. [SEP] what [SEP]", "detok_text": "[CLS] years after israel's capture. [SEP] i think the whole thing is just, well, very good. [SEP] i think it's going to change a lot to that. [SEP] it's time the audience refuses to reflect on the foundation of a creator. [SEP] everything from long shorts, leather pants, silk shirts, raincoats, cut - back jackets and hood - covered tops, grey - banded vests, copper - colored shirts, black suspenders - and - tops. [SEP] sub - prime securities, the firm, was involved in the swap, which saw each of the 500 vehicles on a debt list. [SEP] what [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS], that it would consider limiting voting rights for the funds. [SEP] he had the ability to talk, to talk, to talk, not even speak. [SEP] she opens the door in search of assistance. [SEP] if you can move back and move back alone, the employer would not put you back to work again. [SEP] in return, add together the butter and add a little vanilla. [SEP] about a dozen other items - - bundles of plastic, plastic, furniture and aluminum - - have gone out of circulation since 2002. [SEP] the authorities have put a similar case behind hold in the uk. [SEP] \" for a certain number of our customers [SEP]", "detok_text": "[CLS], that it would consider limiting voting rights for the funds. [SEP] he had the ability to talk, to talk, to talk, not even speak. [SEP] she opens the door in search of assistance. [SEP] if you can move back and move back alone, the employer would not put you back to work again. [SEP] in return, add together the butter and add a little vanilla. [SEP] about a dozen other items - - bundles of plastic, plastic, furniture and aluminum - - have gone out of circulation since 2002. [SEP] the authorities have put a similar case behind hold in the uk. [SEP] \" for a certain number of our customers [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] anti - related, the federal food and drug administration said on tuesday. [SEP] ap news ' jim scirillo in mexico city and glen johnson in washington contributed to this report. [SEP] but he did not address any need for donations. [SEP] in addition to requests for comment from european authorities, the u. s. embassy declined to return phone calls to the associated press for any further comment on tuesday. [SEP] he wanted them to be on the offensive line. [SEP] \" i don ' t think that we would get much rest anytime soon, \" said gordon brown, the chairman of the american asset management association. [SEP] the other side, to [SEP]", "detok_text": "[CLS] anti - related, the federal food and drug administration said on tuesday. [SEP] ap news' jim scirillo in mexico city and glen johnson in washington contributed to this report. [SEP] but he did not address any need for donations. [SEP] in addition to requests for comment from european authorities, the u. s. embassy declined to return phone calls to the associated press for any further comment on tuesday. [SEP] he wanted them to be on the offensive line. [SEP] \"i don't think that we would get much rest anytime soon,\" said gordon brown, the chairman of the american asset management association. [SEP] the other side, to [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] finally showed up. [SEP] \" it ' s going to be an opportunity to have one of us give you all the money. [SEP] i ' m glad a nice, red - haired person who needs to get your family together wants to give you something, such as taking them up for a car, a bed and a room. [SEP] the mental health team examined the results of a forensic examination and the backgrounds of the suspects. [SEP] 104. 85, 84, 104, 84, 98 - 113.... [SEP] the carrier - - airlines - - can operate thousands of flights to the entire united states. [SEP] with the exception of [SEP]", "detok_text": "[CLS] finally showed up. [SEP] \" it's going to be an opportunity to have one of us give you all the money. [SEP] i'm glad a nice, red - haired person who needs to get your family together wants to give you something, such as taking them up for a car, a bed and a room. [SEP] the mental health team examined the results of a forensic examination and the backgrounds of the suspects. [SEP] 104. 85, 84, 104, 84, 98 - 113.... [SEP] the carrier - - airlines - - can operate thousands of flights to the entire united states. [SEP] with the exception of [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS] - 30 % higher than in 2007. [SEP] at the other end of 2 a. m., then 8, 8, 9, 11, 11, 15, and 10, 16, and 18, to get 4, 5, 4, 4, 6, 6, and back on time. [SEP] i stepped into her car and it had been a while, and she needed to do, \" he said. [SEP] and if you do, a good person in the world will have a place to go or to do a job. [SEP] \" i really think he deserves to be in the race, \" said ridley - thomas, [SEP]", "detok_text": "[CLS] - 30 % higher than in 2007. [SEP] at the other end of 2 a. m., then 8, 8, 9, 11, 11, 15, and 10, 16, and 18, to get 4, 5, 4, 4, 6, 6, and back on time. [SEP] i stepped into her car and it had been a while, and she needed to do, \"he said. [SEP] and if you do, a good person in the world will have a place to go or to do a job. [SEP]\" i really think he deserves to be in the race, \" said ridley - thomas, [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], he said. [SEP] he winced, hugged, the crowd froze, and exhaled. [SEP] but, there do appear to be some problems : \" i found the mattress in, on occasion, the passenger drawer. \" [SEP] as a result, he comes out and he says, \" yeah, he has a lot to do. [SEP] i ' m not sure until the lights come out and,,,,,,, all the time, don ' t know, what,,,, what,,, what, what,. [SEP] the industry, flush with money, has run out of cars, planes, cars and planes [SEP]", "detok_text": "[CLS], he said. [SEP] he winced, hugged, the crowd froze, and exhaled. [SEP] but, there do appear to be some problems: \"i found the mattress in, on occasion, the passenger drawer.\" [SEP] as a result, he comes out and he says, \" yeah, he has a lot to do. [SEP] i'm not sure until the lights come out and,,,,,,, all the time, don't know, what,,,, what,,, what, what,. [SEP] the industry, flush with money, has run out of cars, planes, cars and planes [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS]. [SEP] but for a long time, it has to be taken with, he said, \" a great effect. \" [SEP] the project is also a private investment, as part of the sale to the bank of scotland. [SEP] for now, everyone are able to get their names together - - 2, 3, 14,, 8, 12, 11, 13, a word. [SEP] i think so well. [SEP] \" i wanted him to talk to him, \" she added. [SEP] \" i continue to love him for all, \" he said. [SEP] but if there is anything to go by, it doesn ' t work. [SEP]", "detok_text": "[CLS]. [SEP] but for a long time, it has to be taken with, he said, \"a great effect.\" [SEP] the project is also a private investment, as part of the sale to the bank of scotland. [SEP] for now, everyone are able to get their names together - - 2, 3, 14,, 8, 12, 11, 13, a word. [SEP] i think so well. [SEP] \"i wanted him to talk to him,\" she added. [SEP] \"i continue to love him for all,\" he said. [SEP] but if there is anything to go by, it doesn't work. [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS] \" she said. [SEP] so much so i spent my days trying to get back to the house - i would drink in transit, i would never die in a tunnel on a bus - and it came along, so far, so quickly, just because it would stop, and then, then later, off the road. [SEP] then, every day, i mean, 49, 37, 50, i usually have 200, 200, 50, 50, 60 days. [SEP] on a short voyage, the aircraft carried aircraft, planes and equipment to the roof of the united nation ' s fueling system. [SEP] i agree with your assertion [SEP]", "detok_text": "[CLS] \" she said. [SEP] so much so i spent my days trying to get back to the house - i would drink in transit, i would never die in a tunnel on a bus - and it came along, so far, so quickly, just because it would stop, and then, then later, off the road. [SEP] then, every day, i mean, 49, 37, 50, i usually have 200, 200, 50, 50, 60 days. [SEP] on a short voyage, the aircraft carried aircraft, planes and equipment to the roof of the united nation's fueling system. [SEP] i agree with your assertion [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] happens on wall, say, rather, newspapers, it is no reflection of their diversity. [SEP] the story doesn ' t seem to work out the only way of finding a way to feel bad news. [SEP] we started with a computer, two minutes, a few minutes, looking at the hotel ' s small door, looking in its yard. [SEP] a 45 - year - old french student who says she wrote her boyfriend ' s name is on the stand, a court heard. [SEP] i have been in the field since the age of 17, but i never had one. [SEP] but i just think that with the obvious problems, there [SEP]", "detok_text": "[CLS] happens on wall, say, rather, newspapers, it is no reflection of their diversity. [SEP] the story doesn't seem to work out the only way of finding a way to feel bad news. [SEP] we started with a computer, two minutes, a few minutes, looking at the hotel's small door, looking in its yard. [SEP] a 45 - year - old french student who says she wrote her boyfriend's name is on the stand, a court heard. [SEP] i have been in the field since the age of 17, but i never had one. [SEP] but i just think that with the obvious problems, there [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] investors, would seem to include the idea of a short - term buy - out. [SEP] what makes an even greater problem, the truth, is a combination of - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -. [SEP] but it ' s not a time to start and tell us to look here. [SEP] the 21 - year - old midfielder moved to liverpool from the club in 2006. [SEP] the house, kupech said, is expected to be a 300 - foot vehicle with a top speed of 40 miles [SEP]", "detok_text": "[CLS] investors, would seem to include the idea of a short - term buy - out. [SEP] what makes an even greater problem, the truth, is a combination of - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -. [SEP] but it's not a time to start and tell us to look here. [SEP] the 21 - year - old midfielder moved to liverpool from the club in 2006. [SEP] the house, kupech said, is expected to be a 300 - foot vehicle with a top speed of 40 miles [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS] not have the opportunity to speak unless i have to listen to read the novel. [SEP] london ( ap ) - british transport officials have launched a \" demonstration \" operation over the refusal of european union airspace to allow flights to the hubble and a lack of extra transport flights so the mission can expand beyond the end of the full year. [SEP] police are keen to speak to four men, including the father of a baby, who walked in the heart of york street, eastbourne, at 0115 gmt on saturday. [SEP] by the way, fluorescent lights, candles, rubbers and candles come together, shoes, pillows, etc. [SEP]", "detok_text": "[CLS] not have the opportunity to speak unless i have to listen to read the novel. [SEP] london (ap) - british transport officials have launched a \"demonstration\" operation over the refusal of european union airspace to allow flights to the hubble and a lack of extra transport flights so the mission can expand beyond the end of the full year. [SEP] police are keen to speak to four men, including the father of a baby, who walked in the heart of york street, eastbourne, at 0115 gmt on saturday. [SEP] by the way, fluorescent lights, candles, rubbers and candles come together, shoes, pillows, etc. [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] said. [SEP] they may have a good future in self - esteem and we have had to question the trust of children at the end of their lives. [SEP] i like the sparkle of light, i can see from the top windows, the sparkle of the ceiling, the sparkle of lights. [SEP] the bill also includes the use of emergency planes, the use of cargo planes, cargo planes, the use of passenger planes, aircraft and automobiles. [SEP] if to make it for a two - win race against the best team in the world, we are just right to keep on making the most of the game. [SEP] here, it seems, [SEP]", "detok_text": "[CLS] said. [SEP] they may have a good future in self - esteem and we have had to question the trust of children at the end of their lives. [SEP] i like the sparkle of light, i can see from the top windows, the sparkle of the ceiling, the sparkle of lights. [SEP] the bill also includes the use of emergency planes, the use of cargo planes, cargo planes, the use of passenger planes, aircraft and automobiles. [SEP] if to make it for a two - win race against the best team in the world, we are just right to keep on making the most of the game. [SEP] here, it seems, [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] \" he said. [SEP] when hillary clinton told the crowd that she wanted to make \" a fateful ( inky ) gesture out of her mouth, \" my name was raised. [SEP] his coats of black tops and dark white shoes, all clouds white, a long black scarf, a black white hat, and a large - looking black top - - faded and then, again, then we all have to wait and then half,, then half,, half,, the carpet is on. [SEP] the uk ' s foreign minister said in a statement released on monday that it was a \" significant priority \" for efforts to resolve the [SEP]", "detok_text": "[CLS] \"he said. [SEP] when hillary clinton told the crowd that she wanted to make\" a fateful (inky) gesture out of her mouth, \"my name was raised. [SEP] his coats of black tops and dark white shoes, all clouds white, a long black scarf, a black white hat, and a large - looking black top - - faded and then, again, then we all have to wait and then half,, then half,, half,, the carpet is on. [SEP] the uk's foreign minister said in a statement released on monday that it was a\" significant priority \" for efforts to resolve the [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS]. [SEP] \" it was a guy on the other side of a line, saying..., kind of \" shit, wack, \" he said... [SEP] there is a lot of space in all of our minds, that need to think how our lives have changed, \" he said a while earlier. [SEP] a bit of art, that seems to me, comes with an arm and a lot of empty mind. [SEP] \" it is a law they must change, because it is so, \" he said. [SEP] the teen, hamilton of michigan, was arrested in a separate area just days outside his home on a [SEP]", "detok_text": "[CLS]. [SEP] \"it was a guy on the other side of a line, saying..., kind of\" shit, wack, \"he said... [SEP] there is a lot of space in all of our minds, that need to think how our lives have changed,\" he said a while earlier. [SEP] a bit of art, that seems to me, comes with an arm and a lot of empty mind. [SEP] \"it is a law they must change, because it is so,\" he said. [SEP] the teen, hamilton of michigan, was arrested in a separate area just days outside his home on a [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] to be completed in one to two days. [SEP] the government statement said the school would return by december, beginning in 2014. [SEP] overby said she is concerned about the concept behind that decision when she wants to get the job done and vote for it. [SEP] some are very hard, some funky, some making it up and just trying to make a bit more than a bit bland and sweet. [SEP] chicago ( reuters ) - trade leaders, meeting in chicago hoping to boost trade between the u. s. and africa, will meet in a bid to forge a balance on trade, a senior official said on monday. [SEP] the company [SEP]", "detok_text": "[CLS] to be completed in one to two days. [SEP] the government statement said the school would return by december, beginning in 2014. [SEP] overby said she is concerned about the concept behind that decision when she wants to get the job done and vote for it. [SEP] some are very hard, some funky, some making it up and just trying to make a bit more than a bit bland and sweet. [SEP] chicago (reuters) - trade leaders, meeting in chicago hoping to boost trade between the u. s. and africa, will meet in a bid to forge a balance on trade, a senior official said on monday. [SEP] the company [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS], the company has said it will not reveal what they are thinking about. [SEP] \" unfortunately at the moment, many of us have no access to public funding, and refuse to work to deal with the enormous issues. [SEP] he never gets a chance to start, just to start in the locker room. [SEP] a small seating area has been set up inside, and large spaces in the area. [SEP] \" it ' s like he ' s driving, going down in the road, going back on the street at work, going on to back, but going back - in - the - road, down the road, up there. [SEP] [SEP]", "detok_text": "[CLS], the company has said it will not reveal what they are thinking about. [SEP] \"unfortunately at the moment, many of us have no access to public funding, and refuse to work to deal with the enormous issues. [SEP] he never gets a chance to start, just to start in the locker room. [SEP] a small seating area has been set up inside, and large spaces in the area. [SEP]\" it's like he's driving, going down in the road, going back on the street at work, going on to back, but going back - in - the - road, down the road, up there. [SEP] [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] in 2001. [SEP] the farmers, he said, will not do it until 2017, and then will make ends meet in season to season, with the current peaking at a peak of around 50c in two years. [SEP] with the lights of miami, the story turned green, green, black and green, and the dust of black faded in the wind and the stone pillars of the wall again faded. [SEP] the officials, speaking condition of anonymity, agreed that obama ' s withdrawal would continue until the end of the year. [SEP] no, i try to tell you the author may just be a 300 - a - word, [SEP]", "detok_text": "[CLS] in 2001. [SEP] the farmers, he said, will not do it until 2017, and then will make ends meet in season to season, with the current peaking at a peak of around 50c in two years. [SEP] with the lights of miami, the story turned green, green, black and green, and the dust of black faded in the wind and the stone pillars of the wall again faded. [SEP] the officials, speaking condition of anonymity, agreed that obama's withdrawal would continue until the end of the year. [SEP] no, i try to tell you the author may just be a 300 - a - word, [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] unusual, however, at this time. [SEP] people wanted to wake up to understand the situation, \" said to the student, who said the noise was \" fantastic \" and then he got back on the ground. [SEP] i mean sorry, but then you, god, take a day for a tea, some for a pill, men and women. [SEP] \" anything that will happen within the term - - when it is half a century - - will be much harder to prepare for, \" he said. [SEP] the teams spent about four days a week trying to bring the best of the best of the nba chicago, june 30 ( up [SEP]", "detok_text": "[CLS] unusual, however, at this time. [SEP] people wanted to wake up to understand the situation, \"said to the student, who said the noise was\" fantastic \"and then he got back on the ground. [SEP] i mean sorry, but then you, god, take a day for a tea, some for a pill, men and women. [SEP]\" anything that will happen within the term - - when it is half a century - - will be much harder to prepare for, \" he said. [SEP] the teams spent about four days a week trying to bring the best of the best of the nba chicago, june 30 ( up [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] they started to sing, they began laughing, \" she said. [SEP] and, i can ' t understand how, for now, people are willing to drop their wallets and put their noses in the door. [SEP] the family then wanted to get a question - and - answer to where he was going, he said. [SEP] \" here, the game has not come to a close. [SEP] now that the economy is back to the boom - and - bust cycles, and the process continues, the idea that everything is going in a little bit and moving is we have to wait and get a little longer. [SEP] he began with a [SEP]", "detok_text": "[CLS] they started to sing, they began laughing, \"she said. [SEP] and, i can't understand how, for now, people are willing to drop their wallets and put their noses in the door. [SEP] the family then wanted to get a question - and - answer to where he was going, he said. [SEP]\" here, the game has not come to a close. [SEP] now that the economy is back to the boom - and - bust cycles, and the process continues, the idea that everything is going in a little bit and moving is we have to wait and get a little longer. [SEP] he began with a [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS] his plan, and he ruled out it would do something to some of his clients. [SEP] but a few weeks, for me, and for the fans, it has been the time for me to fight, \" he said. [SEP] after a restoration, the final part of the houseboard section of the building, confined to the ceiling railings, returns to the edge of darkness. [SEP] this requirement has been put in one place. [SEP] at least 100 french soldiers have been killed. [SEP] and when i do, i take off, i feel the smell of music in my face. [SEP] he struggles with the breadth of his collection. [SEP]", "detok_text": "[CLS] his plan, and he ruled out it would do something to some of his clients. [SEP] but a few weeks, for me, and for the fans, it has been the time for me to fight, \" he said. [SEP] after a restoration, the final part of the houseboard section of the building, confined to the ceiling railings, returns to the edge of darkness. [SEP] this requirement has been put in one place. [SEP] at least 100 french soldiers have been killed. [SEP] and when i do, i take off, i feel the smell of music in my face. [SEP] he struggles with the breadth of his collection. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] meeting in baghdad, the official told reporters. [SEP] they were the real problem and they were all on their own. [SEP] \" i remember him was once standing on the other side of the room, and with him, he said, come back, look up, he said goodbye, and then he said to me, and he said yes, he was another. [SEP] and, oh, uh - oh, there ' s a lot. [SEP] only a few of the drugs were used in britain to treat serious kidney problems. [SEP] so, then, are the bigger problems. [SEP] \" people don ' t wait for answers. [SEP] \" [SEP]", "detok_text": "[CLS] meeting in baghdad, the official told reporters. [SEP] they were the real problem and they were all on their own. [SEP] \"i remember him was once standing on the other side of the room, and with him, he said, come back, look up, he said goodbye, and then he said to me, and he said yes, he was another. [SEP] and, oh, uh - oh, there's a lot. [SEP] only a few of the drugs were used in britain to treat serious kidney problems. [SEP] so, then, are the bigger problems. [SEP]\" people don't wait for answers. [SEP] \" [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] said. [SEP] the result of our investigation is that the internet is a priority. [SEP] i think the children will find themselves sitting in disbelief, if they are to turn around. [SEP] the financial collapse of the credit crunch, many of its names were being announced, appears to have engulfed some of the world ' s most susceptic economies. [SEP] even when it gets done, that kind of person eats up a hair and refuses to come. [SEP] and the message was clear that, with the end of the olympics in sight, i didn ' t have a sense of humor, or even the thrill of getting in a field. [SEP]", "detok_text": "[CLS] said. [SEP] the result of our investigation is that the internet is a priority. [SEP] i think the children will find themselves sitting in disbelief, if they are to turn around. [SEP] the financial collapse of the credit crunch, many of its names were being announced, appears to have engulfed some of the world's most susceptic economies. [SEP] even when it gets done, that kind of person eats up a hair and refuses to come. [SEP] and the message was clear that, with the end of the olympics in sight, i didn't have a sense of humor, or even the thrill of getting in a field. [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] couple of hours, i would not be able to get the full flight, he said. [SEP] but he knew, and he refused to speak. [SEP] we do not like the things that the person at the top, at a corner, at the top, at the top line, the body, to the top, the bottom line, up to the top. [SEP] while the emotional nature of the story, in which the story is taken by the author ' s son on a huge canvas, has settled the issue, the narrative of moyesque is far deeper than ever. [SEP] so, if i only get through the house, [SEP]", "detok_text": "[CLS] couple of hours, i would not be able to get the full flight, he said. [SEP] but he knew, and he refused to speak. [SEP] we do not like the things that the person at the top, at a corner, at the top, at the top line, the body, to the top, the bottom line, up to the top. [SEP] while the emotional nature of the story, in which the story is taken by the author's son on a huge canvas, has settled the issue, the narrative of moyesque is far deeper than ever. [SEP] so, if i only get through the house, [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS]. [SEP] the hospital has a great room and is a very nice room, a great group, \" he said. [SEP] when everyone talks about him and his accomplishments, i will wonder if they are anything more, just temporary. [SEP] 7, detroit, calgary - toronto 11 - 13, detroit - boston 16, detroit - chicago, detroit - chicago, in place of chicago, detroit - denver. [SEP] more than 30 aircraft, including 13 men, women and one - third of the staff, were scheduled to leave in coming days, the coalition said. [SEP] 5 to serve as head of the special forces command. [SEP] the article appeared [SEP]", "detok_text": "[CLS]. [SEP] the hospital has a great room and is a very nice room, a great group, \" he said. [SEP] when everyone talks about him and his accomplishments, i will wonder if they are anything more, just temporary. [SEP] 7, detroit, calgary - toronto 11 - 13, detroit - boston 16, detroit - chicago, detroit - chicago, in place of chicago, detroit - denver. [SEP] more than 30 aircraft, including 13 men, women and one - third of the staff, were scheduled to leave in coming days, the coalition said. [SEP] 5 to serve as head of the special forces command. [SEP] the article appeared [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] [SEP] that is what is a situation not changed since the end of the 1970s. [SEP] the only way to do, say, say, say, say, look, it ' s a matter of working the hard, with little problem, trying to get the word ' turn ' right. [SEP] yes, however, the distinction is important. [SEP] he just started in chicago, detroit, denver, chicago, before going to the airport. [SEP] but, time is on the line, there are days to be had, now, and then, and, finally, with the chance to become, again, a half - day. [SEP] the [SEP]", "detok_text": "[CLS] [SEP] that is what is a situation not changed since the end of the 1970s. [SEP] the only way to do, say, say, say, say, look, it's a matter of working the hard, with little problem, trying to get the word'turn' right. [SEP] yes, however, the distinction is important. [SEP] he just started in chicago, detroit, denver, chicago, before going to the airport. [SEP] but, time is on the line, there are days to be had, now, and then, and, finally, with the chance to become, again, a half - day. [SEP] the [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS] the girl, a 6 - year - old little girl. [SEP] the baby is ½ - and - 1 - - tucked up in dark pajamas, working in suitcases, bunks, and in pantsuits, in dark pants. [SEP] meanwhile, these researchers are also parachuted in to work with special equipment to deliver these additional multi - wheeled units - - including lifts, lifts, wheelchairs, lifts and - - on support of emc technology. [SEP] canada. [SEP] the plane, £1, 095 ( £11, 772 ), has seven flights. [SEP] \" it ' s like we ' re not talking. [SEP]", "detok_text": "[CLS] the girl, a 6 - year - old little girl. [SEP] the baby is ½ - and - 1 - - tucked up in dark pajamas, working in suitcases, bunks, and in pantsuits, in dark pants. [SEP] meanwhile, these researchers are also parachuted in to work with special equipment to deliver these additional multi - wheeled units - - including lifts, lifts, wheelchairs, lifts and - - on support of emc technology. [SEP] canada. [SEP] the plane, £1, 095 (£11, 772), has seven flights. [SEP] \" it's like we're not talking. [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] chicago in chicago, chicago - to tampa, detroit, and - detroit in cleveland. [SEP] i just think he is going to step down if he doesn ' t plan to return. [SEP] it ' s 60, 50,, 50, 60, - - 50, 50 - - 50, 38, 36, 48 days. [SEP] brown had 16 points and nine rebounds, including a point game, a trip to the blue devils, and even a game in the second period. [SEP] 9, chicago 17, new jersey 18. [SEP] he refused to give his students of dollars and even told them to check in. [SEP] the court heard [SEP]", "detok_text": "[CLS] chicago in chicago, chicago - to tampa, detroit, and - detroit in cleveland. [SEP] i just think he is going to step down if he doesn't plan to return. [SEP] it's 60, 50,, 50, 60, - - 50, 50 - - 50, 38, 36, 48 days. [SEP] brown had 16 points and nine rebounds, including a point game, a trip to the blue devils, and even a game in the second period. [SEP] 9, chicago 17, new jersey 18. [SEP] he refused to give his students of dollars and even told them to check in. [SEP] the court heard [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS] said. [SEP] a lovely, fruit - scented version of wilt vanilla, with a paler shade of lemon flavors. [SEP] chicago is 7 - 4 with a 2 - 2 - 2 era. [SEP] it ' s quite a bit to learn. [SEP] \" he ' s really so clever, he moved quickly through his acting period, and got into a place where he huffed and puffed and rolled up his teeth, opened his eyes. \" [SEP] there are people who have other types of financial support. [SEP] \" the victory will have a huge impact, \" analysts say, for the fast - growing insurgency. [SEP] i never believe that a [SEP]", "detok_text": "[CLS] said. [SEP] a lovely, fruit - scented version of wilt vanilla, with a paler shade of lemon flavors. [SEP] chicago is 7 - 4 with a 2 - 2 - 2 era. [SEP] it's quite a bit to learn. [SEP] \"he's really so clever, he moved quickly through his acting period, and got into a place where he huffed and puffed and rolled up his teeth, opened his eyes.\" [SEP] there are people who have other types of financial support. [SEP] \"the victory will have a huge impact,\" analysts say, for the fast - growing insurgency. [SEP] i never believe that a [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] began in january 2005. [SEP] other cities have made significant gains, including london, in london, and in the midlands, for the last five years. [SEP] \" i think i ' d just like to sleep, but when it is good, you get to sleep, not well, \" he said. [SEP] the next day, however, she is asleep in the next room, but the answer begins to appear, she ' s looking up and laughing. [SEP] \" i don ' t think he is going to talk. [SEP] i have white shirts, white shirts, blackcoats and gray black shirts. [SEP] the complete collapse of american [SEP]", "detok_text": "[CLS] began in january 2005. [SEP] other cities have made significant gains, including london, in london, and in the midlands, for the last five years. [SEP] \"i think i'd just like to sleep, but when it is good, you get to sleep, not well,\" he said. [SEP] the next day, however, she is asleep in the next room, but the answer begins to appear, she's looking up and laughing. [SEP] \" i don't think he is going to talk. [SEP] i have white shirts, white shirts, blackcoats and gray black shirts. [SEP] the complete collapse of american [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] pakistan, comes close to a solution, obama said. [SEP] he walked off in frustration and worked out side - by - side for the second time in a career - long year - - a tie with the series he began in march 2000. [SEP] but overall, the rebels did have a full advantage - - or even, perhaps - - and managed to move inside. [SEP] it may not have to work. [SEP] the aircraft also caters to 1, 200 britons, which are worth 2. 7 million tonnes - - on orders from the government - to the airport. [SEP] the company, which includes 37 airlines and cargo companies, [SEP]", "detok_text": "[CLS] pakistan, comes close to a solution, obama said. [SEP] he walked off in frustration and worked out side - by - side for the second time in a career - long year - - a tie with the series he began in march 2000. [SEP] but overall, the rebels did have a full advantage - - or even, perhaps - - and managed to move inside. [SEP] it may not have to work. [SEP] the aircraft also caters to 1, 200 britons, which are worth 2. 7 million tonnes - - on orders from the government - to the airport. [SEP] the company, which includes 37 airlines and cargo companies, [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] [SEP] \" so it is about everyone, \" mr. he said. [SEP] bring out a good plan to try to keep up with the real economy. [SEP] you know, the big vampires, the elves, the elves. [SEP] we came up, dancing, the stars, that was good, but then i started, and i was really angry, \" he said. [SEP] \" to see that to him, he knows what ' s important. [SEP] israel said it would not want to return and that it would return to hamas. [SEP] at the end of the four - game day, angels starter derek matsui went back with an rbi [SEP]", "detok_text": "[CLS] [SEP] \"so it is about everyone,\" mr. he said. [SEP] bring out a good plan to try to keep up with the real economy. [SEP] you know, the big vampires, the elves, the elves. [SEP] we came up, dancing, the stars, that was good, but then i started, and i was really angry, \"he said. [SEP]\" to see that to him, he knows what's important. [SEP] israel said it would not want to return and that it would return to hamas. [SEP] at the end of the four - game day, angels starter derek matsui went back with an rbi [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] said. [SEP] but when a three - wheeled bus pulled me around, he pulled me into a corner, and pulled me into a corner. [SEP] well, so it was a great game for us. [SEP] foreign flights have been on strike over the past week, with security concerns that could also affect domestic flights. [SEP] we focus on baking, baking, baking, baking, baking, baking, baking, milk, baking, baking, tomato, mint. [SEP] if he ' s 21 years old, so i ' m guessing, you just want him to keep working, you never look back again, he ' s ok, so where [SEP]", "detok_text": "[CLS] said. [SEP] but when a three - wheeled bus pulled me around, he pulled me into a corner, and pulled me into a corner. [SEP] well, so it was a great game for us. [SEP] foreign flights have been on strike over the past week, with security concerns that could also affect domestic flights. [SEP] we focus on baking, baking, baking, baking, baking, baking, baking, milk, baking, baking, tomato, mint. [SEP] if he's 21 years old, so i'm guessing, you just want him to keep working, you never look back again, he's ok, so where [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS]. [SEP] in november 2002, he wrote down the bill and tried to amend the legislation. [SEP] the problem not for the jets, but for the fans and the club. [SEP] i think, from the beginning, to the end, just to the finish line. [SEP] the way the researchers are trying to point out, the problem is real. [SEP] i don ' t know that we have to do that, \" he said. [SEP] look at the details, and then you would get me right, and then i imagine that in the case of a race, i would go - - literally - - from the end of the line. [SEP]", "detok_text": "[CLS]. [SEP] in november 2002, he wrote down the bill and tried to amend the legislation. [SEP] the problem not for the jets, but for the fans and the club. [SEP] i think, from the beginning, to the end, just to the finish line. [SEP] the way the researchers are trying to point out, the problem is real. [SEP] i don't know that we have to do that, \" he said. [SEP] look at the details, and then you would get me right, and then i imagine that in the case of a race, i would go - - literally - - from the end of the line. [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] s a great way to get together, i plan to spend the week in the light of my surroundings, \" he said. [SEP] no one at the stadium went on holiday, we didn ' t know it would be back anyway. [SEP] the idea is to be able to get into something and something new, going right out of the hands of a soldier and getting out of it. [SEP] oh, oh, oh, so much gratitude, and, oh, yes, oh, i love and i love, the last thing it is to remember,,,, so much,,,,,, so much. [SEP] he was [SEP]", "detok_text": "[CLS] s a great way to get together, i plan to spend the week in the light of my surroundings, \" he said. [SEP] no one at the stadium went on holiday, we didn't know it would be back anyway. [SEP] the idea is to be able to get into something and something new, going right out of the hands of a soldier and getting out of it. [SEP] oh, oh, oh, so much gratitude, and, oh, yes, oh, i love and i love, the last thing it is to remember,,,, so much,,,,,, so much. [SEP] he was [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] in particular, but not in my personal case, they have a little smile on their faces. [SEP] for the week, the error was only about 50 %, up from 60 percent for the previous week, again in october 2008, and to 45 percent for the week of march. [SEP] \" i just want to see, \" he said. [SEP] this needs to be true. [SEP] \" so much luck, but the same kind of commitment..... [SEP] at the end of october, you talk again, and not before we, not americans, can look forward, we get it back. [SEP] it was clear that the [SEP]", "detok_text": "[CLS] in particular, but not in my personal case, they have a little smile on their faces. [SEP] for the week, the error was only about 50 %, up from 60 percent for the previous week, again in october 2008, and to 45 percent for the week of march. [SEP] \"i just want to see,\" he said. [SEP] this needs to be true. [SEP] \" so much luck, but the same kind of commitment..... [SEP] at the end of october, you talk again, and not before we, not americans, can look forward, we get it back. [SEP] it was clear that the [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS], \" he said at the end of his speech. [SEP] too many of them, the very end to them, have gone very well in the past. [SEP] the ministry spokesman declined to comment. [SEP] \" written in black, full of powder, on the face of someone on the back. [SEP] so, yeah - - now, walk back to the oval office, and again, a few minutes ahead of the time. [SEP] i was trying to say \" i try to pull that off - i ' ll do that, \" he said. [SEP] i ' ve lost that resolve, \" he said. [SEP] \" i ' m glad [SEP]", "detok_text": "[CLS], \"he said at the end of his speech. [SEP] too many of them, the very end to them, have gone very well in the past. [SEP] the ministry spokesman declined to comment. [SEP]\" written in black, full of powder, on the face of someone on the back. [SEP] so, yeah - - now, walk back to the oval office, and again, a few minutes ahead of the time. [SEP] i was trying to say \"i try to pull that off - i'll do that,\" he said. [SEP] i've lost that resolve, \"he said. [SEP]\" i'm glad [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] have to eat..... [SEP] there is still the real history of the citycentre - - david johnson, the chief executive, wrote a note to the city to name it 1868 - - and then, he would come back to the building. [SEP] \" i would, trying to get over it, get to it - - the road to play, the normal road to travel, to travel, \" he said. [SEP] \" they don ' t really do anything, they ' ve got to do everything. [SEP] that, he said, continues as the character gets to his side. [SEP] the problem was too simple. [SEP]", "detok_text": "[CLS] have to eat..... [SEP] there is still the real history of the citycentre - - david johnson, the chief executive, wrote a note to the city to name it 1868 - - and then, he would come back to the building. [SEP] \"i would, trying to get over it, get to it - - the road to play, the normal road to travel, to travel,\" he said. [SEP] \" they don't really do anything, they've got to do everything. [SEP] that, he said, continues as the character gets to his side. [SEP] the problem was too simple. [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] of their own. [SEP] but, it turns out, they own it. [SEP] marston, 39, admitted he was driving and was taken back to life three days after the 13 - year - old died. [SEP] he also said that he will have to have a further period in the next few months to get a job on a different basis. [SEP] so the idea of having a baby, whether in the sink, or with the baby, may be a sign of social tension, he said. [SEP] the policy was introduced in the late 1970s, but, later, back to the 1980s. [SEP] he was taken to the royal infirmary [SEP]", "detok_text": "[CLS] of their own. [SEP] but, it turns out, they own it. [SEP] marston, 39, admitted he was driving and was taken back to life three days after the 13 - year - old died. [SEP] he also said that he will have to have a further period in the next few months to get a job on a different basis. [SEP] so the idea of having a baby, whether in the sink, or with the baby, may be a sign of social tension, he said. [SEP] the policy was introduced in the late 1970s, but, later, back to the 1980s. [SEP] he was taken to the royal infirmary [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS], 2007. [SEP] the story seemed to be long and true, but ultimately, not true. [SEP] the mulls are always cool.... so they are strong in winter - - usually in days b, b, a, b, a and a. [SEP] he also died about 15 minutes before being killed. [SEP] in the moment, five minutes after the flight began the flight, we sat on the front, right up to the end of the flight, but then we took a look down the air. [SEP] it had been november, december, 2004, and 2004. [SEP] you just get that series 2 - 2. [SEP]", "detok_text": "[CLS], 2007. [SEP] the story seemed to be long and true, but ultimately, not true. [SEP] the mulls are always cool.... so they are strong in winter - - usually in days b, b, a, b, a and a. [SEP] he also died about 15 minutes before being killed. [SEP] in the moment, five minutes after the flight began the flight, we sat on the front, right up to the end of the flight, but then we took a look down the air. [SEP] it had been november, december, 2004, and 2004. [SEP] you just get that series 2 - 2. [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] the study found. [SEP] i think they think, they know, they realize that there ' s so much they do to understand into us now, they ' re kind of doing that sort of stupid thing, they will get to put things in their mouths. [SEP] so since i was moved,, well, i ' ve been in,,,,,, half, half, half, half - i still have a,,, half, half, half, maybe, half, half, half, half, half,. [SEP] and they didn ' t do any of them. [SEP] but in the hotel room, a policeman [SEP]", "detok_text": "[CLS] the study found. [SEP] i think they think, they know, they realize that there's so much they do to understand into us now, they're kind of doing that sort of stupid thing, they will get to put things in their mouths. [SEP] so since i was moved,, well, i've been in,,,,,, half, half, half, half - i still have a,,, half, half, half, maybe, half, half, half, half, half,. [SEP] and they didn't do any of them. [SEP] but in the hotel room, a policeman [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS] [SEP] if you ' re not sure how to drive as a person, what ' s more, especially with the car attached, so you can sit down again, need to feel and feel a bit backward, so you need to get ready to do it, get the focus and come back from the car while the person just goes, and grind it up. [SEP] the court had heard that the alleged incidents took place between now and last november. [SEP] in addition, these businesses will make glues, gels, chemicals to make plastics, such as glues, used in the bottom layers of steel wheels. [SEP] a review of a [SEP]", "detok_text": "[CLS] [SEP] if you're not sure how to drive as a person, what's more, especially with the car attached, so you can sit down again, need to feel and feel a bit backward, so you need to get ready to do it, get the focus and come back from the car while the person just goes, and grind it up. [SEP] the court had heard that the alleged incidents took place between now and last november. [SEP] in addition, these businesses will make glues, gels, chemicals to make plastics, such as glues, used in the bottom layers of steel wheels. [SEP] a review of a [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] to make this work, \" he concluded. [SEP] if cubans don ' t have the cash to raise and pay taxes. [SEP] that wasn ' t. [SEP] and i would love you to get to a real career. [SEP] the website is available : http : / / www. aai. nhs. nhs. co. uk. 08. 0844, 607651, including details of address. [SEP] \" we heard 4, 075 in october, \" it said. [SEP] the spartans came back in the first quarter, and they did not seem to be there, i was just glad. [SEP] a couple of weeks [SEP]", "detok_text": "[CLS] to make this work, \"he concluded. [SEP] if cubans don't have the cash to raise and pay taxes. [SEP] that wasn't. [SEP] and i would love you to get to a real career. [SEP] the website is available: http://www. aai. nhs. nhs. co. uk. 08. 0844, 607651, including details of address. [SEP]\" we heard 4, 075 in october, \" it said. [SEP] the spartans came back in the first quarter, and they did not seem to be there, i was just glad. [SEP] a couple of weeks [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] along with two other children. [SEP] he said that once the roof collapsed, the size of a pyramid, over the wall of the convoy of police trucks had been set in for vehicles around the site around the building. [SEP] the two have various personal relations to date, over a range of weeks and years, he said. [SEP] we do not need to be together, and have a little luck, to be able to eat together, day, in days, in day, days, days, days, and days, and days, \" mr. caer said. [SEP] he started at the same. [SEP] well, i understand. [SEP]", "detok_text": "[CLS] along with two other children. [SEP] he said that once the roof collapsed, the size of a pyramid, over the wall of the convoy of police trucks had been set in for vehicles around the site around the building. [SEP] the two have various personal relations to date, over a range of weeks and years, he said. [SEP] we do not need to be together, and have a little luck, to be able to eat together, day, in days, in day, days, days, days, and days, and days, \" mr. caer said. [SEP] he started at the same. [SEP] well, i understand. [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] in 27 countries, according to an independent survey. [SEP] i often wanted a race for a few days, so i thought about doing one in the early days, but it was like a few days. [SEP] the story will have gone in the air, though, again, with the light of the sun in the sun. [SEP] he didn ' t have to bother either. [SEP] he ' s not sure when he ' s in the room, but the quality of when the lights are there is really important. [SEP] \" there is no chance that they will settle - - either in the capital or in the name of peace. [SEP] he [SEP]", "detok_text": "[CLS] in 27 countries, according to an independent survey. [SEP] i often wanted a race for a few days, so i thought about doing one in the early days, but it was like a few days. [SEP] the story will have gone in the air, though, again, with the light of the sun in the sun. [SEP] he didn't have to bother either. [SEP] he's not sure when he's in the room, but the quality of when the lights are there is really important. [SEP] \" there is no chance that they will settle - - either in the capital or in the name of peace. [SEP] he [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS], have to be normal, we have to be able to work... [SEP] the reality now is that the dusty is over at best, not the worst, he said. [SEP] i feel, in the course of days, maybe, you should be able to say, \" yes \", \" not no. \" [SEP] again, i know, there ' s a sign of a good relationship, down to a point, but the one, you know, where she manages to look out of herself. [SEP] hundreds of soldiers, deployed around the control point, were able to drive the ship out of the harbor, from a [SEP]", "detok_text": "[CLS], have to be normal, we have to be able to work... [SEP] the reality now is that the dusty is over at best, not the worst, he said. [SEP] i feel, in the course of days, maybe, you should be able to say, \"yes\", \"not no.\" [SEP] again, i know, there's a sign of a good relationship, down to a point, but the one, you know, where she manages to look out of herself. [SEP] hundreds of soldiers, deployed around the control point, were able to drive the ship out of the harbor, from a [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] - 3 - d ' 90s. [SEP] you have to get up in the office, in the situation room, have a good look for a new president. [SEP] nowitzki also had assists in chicago and chicago. [SEP] there are other things to make the same decision, but maybe it is me, \" he said. [SEP] i think that people have something to celebrate. [SEP] don ' t want to go to work unless you get a bad day... [SEP] the incident happened there at 2100 gmt on thursday. [SEP] \" so there would have to be a christmas match that would come at around hour, \" said mike [SEP]", "detok_text": "[CLS] - 3 - d' 90s. [SEP] you have to get up in the office, in the situation room, have a good look for a new president. [SEP] nowitzki also had assists in chicago and chicago. [SEP] there are other things to make the same decision, but maybe it is me, \"he said. [SEP] i think that people have something to celebrate. [SEP] don't want to go to work unless you get a bad day... [SEP] the incident happened there at 2100 gmt on thursday. [SEP]\" so there would have to be a christmas match that would come at around hour, \" said mike [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] eight years in power. [SEP] it ' s a joke, a joke, everything. [SEP] the fact that the artist has never spoken is so important, however, that this is just the actual meaning given to the new era of poetry and, she says, a direct testament to the historical connection to the process. [SEP] \" i think there is something good, \" says mr. kiosk, who is in the age of 68. [SEP] \" now it has to wait three years for something. [SEP] he had been on the last day of the attack. [SEP] it was short, dark, paler and dark gray. [SEP] however, [SEP]", "detok_text": "[CLS] eight years in power. [SEP] it's a joke, a joke, everything. [SEP] the fact that the artist has never spoken is so important, however, that this is just the actual meaning given to the new era of poetry and, she says, a direct testament to the historical connection to the process. [SEP] \"i think there is something good,\" says mr. kiosk, who is in the age of 68. [SEP] \" now it has to wait three years for something. [SEP] he had been on the last day of the attack. [SEP] it was short, dark, paler and dark gray. [SEP] however, [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS] the league start. [SEP] the union ' s meeting is to take the walk - off in preparation for the completion of the site. [SEP] no..... we buy all those products. [SEP] the court is expected to hear a number of civil rights cases. [SEP] it ' s a situation. [SEP] the larger point is that their work is likely to be more complex. [SEP] \" to the right now, that is ridiculous, \" he said. [SEP] cook in the oven for hundreds of minutes. [SEP] a lot of things have come down, we ' ve been through a lot of mistakes. [SEP] a bank of england in the [SEP]", "detok_text": "[CLS] the league start. [SEP] the union's meeting is to take the walk - off in preparation for the completion of the site. [SEP] no..... we buy all those products. [SEP] the court is expected to hear a number of civil rights cases. [SEP] it's a situation. [SEP] the larger point is that their work is likely to be more complex. [SEP] \"to the right now, that is ridiculous,\" he said. [SEP] cook in the oven for hundreds of minutes. [SEP] a lot of things have come down, we've been through a lot of mistakes. [SEP] a bank of england in the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS], unable to get in a day out. [SEP] he said the figure would have been increased to £3. 3m. [SEP] the answer is not clear, so give you a something - in - a - mouth.... [SEP] instead, the station will move clockwise, just on the roof, on the outer side, and in the face of the full - side roof, with a full - side effect on the roof. [SEP] that roll call came at noon on friday, just days before the poll results showed up. [SEP] \" the tsa has a better sense of ability to handle security and security issues, \" said bob [SEP]", "detok_text": "[CLS], unable to get in a day out. [SEP] he said the figure would have been increased to £3. 3m. [SEP] the answer is not clear, so give you a something - in - a - mouth.... [SEP] instead, the station will move clockwise, just on the roof, on the outer side, and in the face of the full - side roof, with a full - side effect on the roof. [SEP] that roll call came at noon on friday, just days before the poll results showed up. [SEP] \"the tsa has a better sense of ability to handle security and security issues,\" said bob [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] to take the loan. [SEP] a couple of hours after the break, at least, as the truck creeps, he swaggers the end of the show, warming up to back - to - back performances. [SEP] that was a reality early in the series. [SEP] \" i do feel lucky. [SEP] everything i have remember has never been true. [SEP] there was a chance for me to get into something - - to get a little better, to get a little better, and get more in shape. [SEP] \" there, i got a call, and then, i came back - - - but i stayed because i thought i [SEP]", "detok_text": "[CLS] to take the loan. [SEP] a couple of hours after the break, at least, as the truck creeps, he swaggers the end of the show, warming up to back - to - back performances. [SEP] that was a reality early in the series. [SEP] \"i do feel lucky. [SEP] everything i have remember has never been true. [SEP] there was a chance for me to get into something - - to get a little better, to get a little better, and get more in shape. [SEP]\" there, i got a call, and then, i came back - - - but i stayed because i thought i [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] don ' t have to pay to get in care, but we know, we could not cover it. [SEP] it was a draw. [SEP] this time, he ' s off to stay a little longer, so i ' m delighted. [SEP] we asked if, with the kids, we wanted to get back on, and maybe even. [SEP] the moment, zeger said, he was unable to get out of his home in the back of a car, even though he did not die. [SEP] 70, 73 - 70, 73 - 80, 73,,,,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS] don't have to pay to get in care, but we know, we could not cover it. [SEP] it was a draw. [SEP] this time, he's off to stay a little longer, so i'm delighted. [SEP] we asked if, with the kids, we wanted to get back on, and maybe even. [SEP] the moment, zeger said, he was unable to get out of his home in the back of a car, even though he did not die. [SEP] 70, 73 - 70, 73 - 80, 73,,,,,,,,,,,,,,,, [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] \" i ' m not sure i have the type of quality and that i have to make a strong commitment to the club. [SEP] in that process comes the talk of his \" impact \" memoir, in which he loses his power and seems to keep on his feet. [SEP] \" i urge the leaders... to move carefully and believe that the u. s. needs to be able to resolve problems in pakistan, \" she said. [SEP] i know you also have to cover things. [SEP] unemployment, which rose in december, rose by 1. 3m in december from a year ago for the first full year, which began to [SEP]", "detok_text": "[CLS] \"i'm not sure i have the type of quality and that i have to make a strong commitment to the club. [SEP] in that process comes the talk of his\" impact \"memoir, in which he loses his power and seems to keep on his feet. [SEP]\" i urge the leaders... to move carefully and believe that the u. s. needs to be able to resolve problems in pakistan, \" she said. [SEP] i know you also have to cover things. [SEP] unemployment, which rose in december, rose by 1. 3m in december from a year ago for the first full year, which began to [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] presence in the audience, especially in black, but it is not confirmed. [SEP] just how much difference is there really when a person turns into the air rage? [SEP] since a snow - days, period, period, and days, the winter period in the ice there has been a full period in the cold water, a full days, days, from day to day in the sun, to the arctic circle, then days, back to the water, ice in the afternoon, ice in the day, the ice in a deep place in the snow. [SEP] so i had to start three days later. [SEP] however, it seems to [SEP]", "detok_text": "[CLS] presence in the audience, especially in black, but it is not confirmed. [SEP] just how much difference is there really when a person turns into the air rage? [SEP] since a snow - days, period, period, and days, the winter period in the ice there has been a full period in the cold water, a full days, days, from day to day in the sun, to the arctic circle, then days, back to the water, ice in the afternoon, ice in the day, the ice in a deep place in the snow. [SEP] so i had to start three days later. [SEP] however, it seems to [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] was, briefly, a \" fresh dog \" in a freezer, so i could take the walk. [SEP] at the end of the day, then, he seems to have won. [SEP] he said the monthly fees might have been a temporary fact, since he had less time to invest in his work but would have to give him more money, or he wanted to buy more goods. [SEP] an additional 1, 200 jobs were on the private payroll in january, down from 42, 000 in december 2006, and up 4 percent from the year before. [SEP] denver, detroit, boston 90, chicago, chicago, chicago 80, cleveland [SEP]", "detok_text": "[CLS] was, briefly, a \"fresh dog\" in a freezer, so i could take the walk. [SEP] at the end of the day, then, he seems to have won. [SEP] he said the monthly fees might have been a temporary fact, since he had less time to invest in his work but would have to give him more money, or he wanted to buy more goods. [SEP] an additional 1, 200 jobs were on the private payroll in january, down from 42, 000 in december 2006, and up 4 percent from the year before. [SEP] denver, detroit, boston 90, chicago, chicago, chicago 80, cleveland [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] of poverty, is one of the problems, he says. [SEP] i do now have to say in person what things have to get done at the same time. [SEP] i was on the plane, and yes, everyone has to do anything, so the travel chaos was so much that i wanted to go there and then i wanted to have a flight. [SEP] of course, then, then, yes, what has to be done. [SEP] what a do, for you,,,,,,,,,,,,,,,,,,,,,,,. [SEP] the career leader, a 13 - year [SEP]", "detok_text": "[CLS] of poverty, is one of the problems, he says. [SEP] i do now have to say in person what things have to get done at the same time. [SEP] i was on the plane, and yes, everyone has to do anything, so the travel chaos was so much that i wanted to go there and then i wanted to have a flight. [SEP] of course, then, then, yes, what has to be done. [SEP] what a do, for you,,,,,,,,,,,,,,,,,,,,,,,. [SEP] the career leader, a 13 - year [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] said. [SEP] \" when someone has arrived i have to keep a sense of perspective on all the places. [SEP] the technical problems were a problem for the colts. [SEP] the rangers moved into the spot with a 1 - 3 record, and a 17 - point lead with detroit and new york in the al east. [SEP] and, it said, the companies must have the flexibility to manage their budgets when they want to make big money. [SEP] \" we have asked what the outcome of the problem is, and we want to address it. [SEP] the problem is that well into next year ' s disastrous presidential election - - a period when mr [SEP]", "detok_text": "[CLS] said. [SEP] \"when someone has arrived i have to keep a sense of perspective on all the places. [SEP] the technical problems were a problem for the colts. [SEP] the rangers moved into the spot with a 1 - 3 record, and a 17 - point lead with detroit and new york in the al east. [SEP] and, it said, the companies must have the flexibility to manage their budgets when they want to make big money. [SEP]\" we have asked what the outcome of the problem is, and we want to address it. [SEP] the problem is that well into next year's disastrous presidential election - - a period when mr [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/state_c256_t1p45_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/state_c256_t1p45_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..0a7aa0ae9a36b8bdffe78ef9dc6b53c2c6ee93e0 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/state_c256_t1p45_detok_raw_samples.txt @@ -0,0 +1,228 @@ +state_c256_t1p45_detok +{ + "type": "summary", + "name": "state_c256_t1p45", + "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", + "step": 124000, + "decode": { + "kind": "categorical_fullvocab", + "config": "state_c256_t1p45", + "steps": 64, + "model_t_mode": "post", + "support_power": 1.0, + "semantic_power": 1.0, + "endpoint_temp": 1.45, + "concentration_min": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 42.24168306980635, + "nll_per_token": 3.7434074840068114, + "tokens": 9506 + }, + "diversity": { + "sample_entropy": 4.010304198715844, + "unique_tokens": 1579, + "token_count": 8192, + "distinct_1": 0.1927490234375, + "distinct_2": 0.6353346456692913, + "top_token_mass": 0.0780029296875 + } +} + +===== sample 000 ===== +[CLS] said earlier that it had no plans for the plans, but said they wanted to close the project. [SEP] "there's also a need to maintain a base rate cut of 15 per cent to the level of the government's plan," he said. [SEP] they had been given a 45 minutes to respond in the middle of that match. [SEP] how about the iphone? [SEP] however, at & t believes the austere is over. [SEP] you have paid a few days to get the money, and this is not the manager's idea - - it's not true. [SEP] you can see a piece of the [SEP] + +===== sample 001 ===== +[CLS] - - it has to deliver power for no more than 90 minutes. [SEP] add it and leave it up, gently, then half - covered, in less than a minute, in my case. [SEP] it is just around the time we get to the old obama - style relationship, and when he is really ill, he takes in the air and takes him to do some of teddy's better work. [SEP] the answer is to think that, if it's your flight, the world will know: maybe you have to do it and more likely to know how to do it. [SEP] 2.... [SEP] he, [SEP] + +===== sample 002 ===== +[CLS] when it goes into bankruptcy and - - no more than $50m - - the damage proceeds, and ends with a bond to repay. [SEP] but, eventually, the colts managed to provide a much - needed run. [SEP] in a autumn afternoon, up a mile from the airport, the wheels of the car are off. [SEP] numbers 6, number 3, 6, 7, 4, and 5 - 601. 5. based on the nature of their organization. [SEP] then, it becomes much smaller - - even more so. [SEP] "we hope they have to learn, and they know where there was that time," [SEP] + +===== sample 003 ===== +[CLS] back in the first place - - a phenomenon known as academic genius - - as well as stretching the whole way back to 1974. [SEP] (ap) - - a student trying to remember a child's identity is, perhaps, a valuable, overthrown thing, if you can't buy this kind of piece of background music. [SEP] it is very sad. [SEP] the current, self - righteous leader is their current leader, a tenacious, self - centered, morgenist cult that has no sense to believe in. [SEP] and a whole lot of them on the edge of the field in a huff - - [SEP] + +===== sample 004 ===== +[CLS], including bi - oil, salt and flour, in food and water. [SEP] they will face their countries, who have had more success than in 2008. [SEP] and nothing, and nothing. [SEP] there to have a bit of work to do, be good, go home, be a good date, come, have a good day. [SEP] you have to just cook constantly, bring in butter and water, then place the butter in the pan, add pieces and boil the butter. [SEP] " but when you work with the people, i will bring him together with the leader, you have to have lots of views. [SEP] instead, [SEP] + +===== sample 005 ===== +[CLS], and others. [SEP] we'll go back and you, the children, keep getting in, school, maybe, maybe, they can, but come up early. [SEP] the former senator, of san diego, california, still knows enough to get home with him. [SEP] today, most of them actually figure in short stories. [SEP] during seven years in the organization, she never lost her life, " he said, sitting in the studio for a week. [SEP] north american tile designs are modular and modular parts - - they are bigger and better than - metal equipment - - components, manufacturing, and equipment from all angles, from [SEP] + +===== sample 006 ===== +[CLS]. m. [SEP] in these economic situations, you can use conventional security on a flight to check the bag, and bring it in order - - ready to carry up one side - - to the airport. [SEP] david baker, head of the highways agency, said that more than 10 % of staff were now due to work the town's full - time or temporary work day. [SEP] "that's awful and bad, especially to get and go down," said garcey. [SEP] and the rules are so simple. [SEP] " for all who have been here for hundreds of years, don't think that even one [SEP] + +===== sample 007 ===== +[CLS]. [SEP] she told him he was what he did, and then he got into his own seat. [SEP] if i can work for more than a year.... and that's my dream. [SEP] sure, if gays are born, there would have to be a president, so move on to that will and continue to serve. [SEP] the answer is one of the same things. [SEP] " he is pretty, young, very talented and led his team in the super bowl. [SEP] he agrees with his father's words. [SEP] to some, that has never been quite long - - since he was his schoolboy [SEP] + +===== sample 008 ===== +[CLS]ed by britain's taste for cash. [SEP] the bidding process is also due in early 2010. [SEP] d. a.'s refine and clothe material injects large layers of light - - in the smalls of the magnets, a much bigger 12c away, and in the vacuum it is now possible to build up a series of heat tubes, working through the floor that makes them look similar in size to the so - called light - ray 15c. [SEP] 25 - 25 2007. [SEP] however she was only three days on a leave, and up to three hours on a waiting list. [SEP] the [SEP] + +===== sample 009 ===== +[CLS], i spent much of the day looking for a solution. [SEP] they saw the tarp from the ceiling and saw a picture of the animal. [SEP] then she began to do the same in the french embassy, where she worked. [SEP] the vatican has also said it will not comment on the shooting. [SEP] the show took between everything - - in planes, blankets, sometimes in the space of days, but sometimes in the combination of food, water, water and sleep - - and between 100 and 100, 000. [SEP] the israeli leader, at home in mumbai, said that it would take a lot of time. [SEP] he is [SEP] + +===== sample 010 ===== +[CLS] reporting in london, england; contributed reporting from beijing. [SEP] ap writer tom mclachler in jackson, miss, and steven esher in washington contributed to this report. [SEP] however, i like the big shift in london. [SEP] in advance of the second world war in italy, the u. s. military appeared to function in the province, whose total u. s. presence was about 3, 000 during its occupation in the united states. [SEP] to avoid that, the u. s. has to extend the foreign combat period to a minimum of 10 weeks before leaving for 60 days. [SEP] and in other hand, the [SEP] + +===== sample 011 ===== +[CLS] making it up, then, instead of a 10 - year plan to finish a full - year career. [SEP] the toaster's costs ($364, including a person) for two four - course cabets, a small package from 20, 000 swiss francs ($50, 000, £377). [SEP] the planes will be kept in operation until a full period and working for two weeks. [SEP] (cnn) - - you like to work day a day for the next week. [SEP] it could be a joke. [SEP] the rebound in its value will further come as companies try to cope with the current turmoil [SEP] + +===== sample 012 ===== +[CLS] to take time to answer a very complex question. [SEP] he and the others sat together for several minutes, all three seemed to show any emotion in the middle of their lives. [SEP] the whole scandal is the biggest lob of pakistan's history. [SEP] then i got on the bus. [SEP] i walked, stepped into the tunnel and saw the good old men, and i did, smack something into my heart. [SEP] james gafiz, a spokesman at the embassy in the capital was unable to be reached. [SEP] for a while he can finally admit that he needs to have a little time at work. [SEP] that way, [SEP] + +===== sample 013 ===== +[CLS] [SEP] there is a way between seeing, say, the stories of patients and their children this summer, but one, i will remember, at the end of the day when doctors seem to understand that others have been brought up, that there is always the look and the look of a person, who is always going up together. [SEP] mr brown said that over the years we have learned a lot about the future of education, something that has been lost in hard times. [SEP] " if we get the money, continue to lend... to the federal government for its budget, we can keep the money for a year to come. [SEP] + +===== sample 014 ===== +[CLS]. [SEP] but the police are "throwing their best" at sir brown, who said, "not a murderer." [SEP] the state would need a further 1, 000 tonnes of cash to be invested in it. [SEP] the best way to bring my seat is a couple of days of paper, i've gone to days, not days, days, days, not days. [SEP] "it will be a very tough week to be so close and final." [SEP] harman said that even if they had a decent plan, repairs were ongoing. [SEP] he would like to have the opportunity. [SEP] the u. s. government [SEP] + +===== sample 015 ===== +[CLS] but given that people have so much power, they must be able to give it a lift, so i would think about it. [SEP] our system seems to run information on the right side in each of our desks, just as the computer just puts it in a drawer and takes it off. [SEP] in addition, multi - forces, in particular, are the result of a number of activities, including various programs to develop ground - to - ground control systems to support operations, security control systems, vehicle - control systems, control and navigation systems for all types of vehicles, and a circuiting system to effectively move the sort of information [SEP] + +===== sample 016 ===== +[CLS] s name. [SEP] it's not true, though. [SEP] at the other end of the scale you don't see at the start, and, at the top end to the end, you turn to the front and back. [SEP] he will take out the look of the basics: pillows, linens, linens, linens, linens, fire - air chairs, and pillows. [SEP] also, an old person is willing to accept the pressure of taking months off to get the job. [SEP] "the city is completely clean but i would be able to stay in this place," said the opposition leader. [SEP] [SEP] + +===== sample 017 ===== +[CLS] to have a relationship with the other. [SEP] fris is known for being a business lawyer. [SEP] an even larger crowd - - 2, 400 students and 5 teachers - - attended the program in august, and now that costs $12 - - at a cost of $2, 500 - - to attend. [SEP] "we want to win but now, we're going to take some of us to get here. [SEP] he is also an avc politician, in describing such words as" white nationalism "and" racial nationalism. "[SEP] he also claims that the control in local government starts with" cuts, " according to [SEP] + +===== sample 018 ===== +[CLS] [SEP] he, he said, falls on his feet and refuses to drop dead. [SEP] london (ap) - london's index of leading shares jumped to record levels and reached 50 points, closing below 17. 2 on friday. [SEP] "as much as a true person, you can think, you will do the job and, ultimately, will have to give a bit of thought to the truth. [SEP]" the people know that the desire to help me achieve further work is no secret, he says. [SEP] in january, the council issued a road plan in the area of chap thurp, the most famous architect. [SEP] + +===== sample 019 ===== +[CLS] thursday. [SEP] i want to lie, or be self - deprecating, about the relationship. [SEP] the children had taken care of the bedroom. [SEP] some of the students are said to have been democrats from the tory party, and some of them admitted, in the end, the terms of their agreement were only a matter of a matter. [SEP] it's time to sit in and get out in the back of the car. [SEP] but for a brief moment, we stopped his car from the other side of the road and we, just a mile away, were taking most of the journey. [SEP] here, you know, [SEP] + +===== sample 020 ===== +[CLS] in new york. [SEP] the building company plans to bring its 300 employees to the b. r. s. from 16, 300 - seat aircraft and 16, 000 - 16, 500 aircraft during the second world war ii. [SEP] the problem is that, as well as having the wheel right, and holding it to the same side of tracks, the electric train then turns back, three or later, between steps and ramps, when it is to have to turn a place before the road ends. [SEP] obama is returning from his presidential campaign in texas on saturday. [SEP] look, now and then.... [SEP] however, the [SEP] + +===== sample 021 ===== +[CLS]'t think it was difficult to make it a part of the business, "said mark morris, head of research strategy at bg & markets in india. [SEP] he said he is prepared to come here in a" more relaxed, more stable, mood in manchester for a while. "[SEP] the deadline is nov. [SEP]" i have to believe that the various apparent problems associated with the establishment of the rail commission haven't connected to any crime. [SEP] "the change is that people have family, friends, and people who always see that kind of day as a time for change," he didn't say. [SEP] [SEP] + +===== sample 022 ===== +[CLS] the year... [SEP] on the other hand, the house is filled with the art and light, the light and light, the spouting of skin, the huge lemon - scented green and white, filled with giant trees and pinks. [SEP] after some years of baking on the ground, a deep yellow sweeter, which - - the deep red, brown sugar, and the smell of peppery water - - ended with salted water. [SEP] in addition, carmakers are printed with red red ink and make long brown paper. [SEP] " a few months later, someone went in to put out a special effort in [SEP] + +===== sample 023 ===== +[CLS], he was much younger and kind. [SEP] that made all the difference. [SEP] his lawyer, david patterson, said that he had been on the plane, but had refused to leave. [SEP] mr phillips said it is not his responsibility for the women to talk. [SEP] then there will be nothing worse. [SEP] the sale, with a residual value of $1. 6 million, until 2010, with a loss reduction of at least $500 million, is expected, brokers say. [SEP] as the battle got out, i began to look nonpollenty. [SEP] " it has never been a small operation, and the results of [SEP] + +===== sample 024 ===== +[CLS] to do. [SEP] ms robinson, who has asked mr robinson to become the minister, said yesterday that the parties entered into a second agreement, with the first minister, days after the issue was agreed in november 2007. [SEP] it's a combination of opportunities, many games, long, hard relationships. [SEP] in the end he took a lot of hurt. [SEP] they will make friends when he's in the house, she said. [SEP] mr mccafe, microsoft's business manager, pulls down a "note" about it, taking it like a dead end. [SEP] " we have not had a car in the past [SEP] + +===== sample 025 ===== +[CLS] to produce data. [SEP] " they'll be able to hire, hire, to hire, dress and hire. - - plus, the group will get enough money to do in the future, he said. [SEP] i mean everything, but for obama who wants to run a vote for a woman, look forward and vote for men and women. [SEP] and now that everything looks for sale, of course, it is like a go - between. [SEP] we want to work together. [SEP] he said he didn't speak about that. [SEP] they need to make a statement. [SEP] madison, wis., june 30 ( up [SEP] + +===== sample 026 ===== +[CLS], then come with them, after all, "he says. [SEP] and, the answer is, but, pretty simple. [SEP] people will need to build their egos on their own, and be the one to work in the mud and obliate them and put them together in order to make that thing happen. [SEP] david letterman, the former reality - show host, agrees. [SEP] he said the fans would continue to do his best to succeed. [SEP] they put me out of here. [SEP] but it is going to be. [SEP] i look at the city as well as i do in the city," he said. [SEP] + +===== sample 027 ===== +[CLS] and a little more. [SEP] top of the mutton. [SEP] "now the definition of the problem is clear," he said. [SEP] the group, which has been lobbying against the plan for the first time as recently as september, had not announced its final numbers. [SEP] the man, in a wheelchair, unable to cover his skis, cuts to the back and side of his head, was able to close the man. [SEP] but i'm not a gooder. [SEP] i just read that one of the other's brothers died in bed when he had died. [SEP] it is not that this has surprised me. [SEP] + +===== sample 028 ===== +[CLS] interest in northern pakistan, " he said. [SEP] it was the first time al - marri had been hurt. [SEP] 2 ) the road was closed off and tied to the same wall. [SEP] he grew up, he said he was a great boy, and he came back from a couple of years on radio. [SEP] he called for the trains to start from home to the site because of the delay. [SEP] however, every day i get something to go on, it has to look all over me, so now i could really get a look on the face. [SEP] he can do what's right down to the north. [SEP] + +===== sample 029 ===== +[CLS] airport. [SEP] the overall use of european powers on the internet is a blow to the eu and the countries will find it harder to work together if they are to get any traction. [SEP] new york (ap) - - with the political jam settled, the evidence is bleak, but some experts say there's still a long way to go. [SEP] and if it is enough to do that - - eventually, the law will change. [SEP] there are two plastic bags on them - - chairs, linens and towels at one end of the head, one paper at the other, another on the outside of the pillow, the inside [SEP] + +===== sample 030 ===== +[CLS] at the time, so she called the police department in hopes of getting her kids back. [SEP] a _ detroit 2 of 2, chicago 1. [SEP] i always remember that again there was a lot - - pain, of a half - deep, sleep, half - force fatigue, the deep pain, the failure to realize that there was some of these issues to be resolved. [SEP] he opened his eyes, but returned for a few seconds before the full picture was shown to him. [SEP] that is, admittedly, the level of such assertions. [SEP] he has a bit to prove. [SEP] i can see that the attitude is [SEP] + +===== sample 031 ===== +[CLS] "you need to believe that a game of life and i has so far let that go," he said. [SEP] he got on with him and his girlfriend, and both of them. [SEP] phoenix 24, boston, watson 24 (new york 24 - - chicago 2, detroit 19, chicago 2 - brown 2 - 2). [SEP] the night, off - time, late in the night, i didn't... [SEP] to keep to a good touch with the dog, they have to pretend that the dog is simply working, not working, but is making it in the wild. [SEP] " and that means that [SEP] + +===== sample 032 ===== +[CLS] tell him that there is a lot of pressure at the top of the road. [SEP] the only time he was elected was two years ago, when he said that, according to an analysis by a military tribunal, he had little in his system to try. [SEP] the knicks' agreement with vick marks a new chapter in the days of the jets' current owner - - willie walsh - - along with a multi - year deal. [SEP] while the chef was on my own, i would stay there full time - - until he left, perhaps, later, with the whole room filled with white linen. [SEP] while it helps that the [SEP] + +===== sample 033 ===== +[CLS] the lead on a 6 - 2 run early in the quarter. [SEP] in chicago, executives from cbs group inc. picked up the tag with him, and he's expected to appear in the event at the center of the museum. [SEP] but all of them are thought to be having to work out a number of layers of salt, ice and placity - - the coast, mountain roads and even roads, trains, trains, railway stations, and the metropolitan area - - before to be exposed to the snow. [SEP] bring in everything - - top, buttery, pan - cover and vanilla - mix with salt, and [SEP] + +===== sample 034 ===== +[CLS] season. [SEP] the half - mile will bring in about 1, 000 in july, with the use of four cars on the manchester and liverpool roads. [SEP] the plan was no insurance option. [SEP] bring boil, low heat, wash - water to boil, or, as much as possible, make it into a large bowl. [SEP] and then, finally, it is, in the long ahead, a more expensive name. [SEP] but we've got him in your corner. [SEP] where is anyone going for the white house. [SEP] i think, really, that makes it look much better. [SEP] only 11. 30am: we [SEP] + +===== sample 035 ===== +[CLS] " the group's mark steel said. [SEP] get back to work, then start to the back of the union. [SEP] but take off in a taxi, get to london and get to london - the train is more, not less. [SEP] when he said that the violence happened, he was only allowed to talk again, and pointed to a point where she lied. [SEP] he and ba tried to put a sign on the flight, and there is some confusion about those details. [SEP] a few bubbles - - in place, a pinch of butter and, often, in it - - sat at the bottom of the fridge. [SEP] [SEP] + +===== sample 036 ===== +[CLS] up, it does not make much sense, "ocampo told afp. [SEP]" and in the meantime, said his wife,,, c.,,,,,,,,,,,,,,,,,,,,,, on the top of the middle of the table, and on the back in the middle of the room, but the whole time was still around s. 5 as the light fell. [SEP] they are part of a lot when you need to do in a company by being a coach, but with listening in person and sitting in person. [SEP] the uk is one of [SEP] + +===== sample 037 ===== +[CLS] want to enjoy. [SEP] on wednesday, obama and obama have to work over their ideas, together to work together and to work on the same. [SEP] the white house will not respond to any decisions in six months, "he said. [SEP] you can work, in turn, and cook together in some flour (or liquid) to try to balance the juices. [SEP] the difference is that hard to understand, that people must be able to voice that message. [SEP]" with a coach, the time is, once or even twice, take off, " he said. [SEP] the deal, however, was to close in october, [SEP] + +===== sample 038 ===== +[CLS], "he said. [SEP] you just have to take it off, he can buy a pair of long - lasting pants. [SEP] the world should have tried to wait, but by now we were hoping for the worst. [SEP] we love you, with great boos, and lots of boos; i mean, if your answer is short," yes. " [SEP] the difference narrowed. [SEP] and, hey, there's a moon. [SEP] now, that veteran needs to leave and turn again - - and he will have to wait to pass this season - - back. [SEP] but he is getting into the green ground in [SEP] + +===== sample 039 ===== +[CLS] 80 percent of the equivalent of 100 million yuan in value, " he said. [SEP] the company has cancelled flights in the last week and expanded to 12 hours and 48 hours a day over a seven - day - week and 14 day period over the past five years. [SEP] you'll also see a look of the first two performances, prior to the play in 14 minutes. [SEP] the old dresses, dressed anonymously as black dresses, was knotted together, teetering along the walls on a sheet lined with white coats strung together in a heavy yellow blanket. [SEP] the capitals's streak began a year after the game, with the [SEP] + +===== sample 040 ===== +[CLS] - he's only one person. [SEP] the historic 7 - 2 victory put the broncos in the same playoffs for the first time since 1991 - - and the first in franchise history. [SEP] when it was presented to the audience, changes to the story, i thought, were something of a flurry of drama, and, crucially, all of the talk said, that it was never the name of the opera house. [SEP] place the butter in the pars, and leave the butter in the oven, stirring in the pans, and lay the onion together in the pan. [SEP] the falcons are waiting for a review. [SEP] + +===== sample 041 ===== +[CLS] - t :... hi, i want to work in iran. [SEP] the trail features 10 men in skis able to run hundreds of miles, in within miles and in minutes. [SEP] they can, in other words, drive you back to the top - down destination for a while - - the same right out of the sun. [SEP] they had the risk of death. [SEP] unfortunately, though, he didn't realize, even the traditionalists, that he did so at all. [SEP] "the world economy is trying to recover, but things can be much worse," he said. [SEP] for the second quarter of [SEP] + +===== sample 042 ===== +[CLS] of god, to his work as a lawyer, and as a grunder. [SEP] what a shame for me, and i would glad to have a new friend from north korea with a great bit of help at work if you want to look in the mirror just a little. [SEP] 40 and 30 - year - old artists - - who have been able to see the local works on so much of their short story lines - - are gone, he said. [SEP] if you want to vote, you have...... od7 dww albyn2rxwb i arrived just before the [SEP] + +===== sample 043 ===== +[CLS], we've made a lot of other progress. [SEP] we were all leaving at the other end of the tunnel, but when we spoke they were terrified at the prospect of having to move. [SEP] mr brown is accused of having "a huge attack" on his daughter after he drank alcohol. [SEP] i knew when he was 20, the equivalent of a ball - - and maybe a card - - and a good tool to get the ability to control the ball - - but that just was going to be his hand. [SEP] "we can never get a divorce - - and we're still married," said. [SEP] he [SEP] + +===== sample 044 ===== +[CLS] his way back to the penalty area. [SEP] with the opening of its facility, the dc/b/f - series, b - 8, mdc technologies is a leader in confill solutions for advanced high - powered, land - based power systems. [SEP] before you do, forget to feel in a daze - - it can mean through the top of the wall, just before you touch it at the side of the wall. [SEP] they don't know that, when the story just comes together, then, change at the bad times, then, maybe, then again, and it's back in the black. [SEP] + +===== sample 045 ===== +[CLS] august last year. [SEP] so, to come out, at the road, at the down, at the ground, at the side, to at the door, to get the door, at the back end of the turn, on a path, and we are going back down, we are already able to stop and to have a reverse journey up there, just to work again... and he seems to have a path with a path that is out of the end of the starting point. [SEP] " the children are in the class, and well, half our children. [SEP] the airline will be able to pay as much as [SEP] + +===== sample 046 ===== +[CLS] of anything he's ever said to him, and that's true. [SEP] here there are differences in the two - state relationship. [SEP] he says he is "very self - functioning." [SEP] i will try to get into this way... [SEP] their victory resulted in the best start of the day. [SEP] in the end, it seemed to be a film that went far in its direction and, to some extent, nothing less than a political special. [SEP] mr. brown talks about the results. [SEP] it is, it's right, the droves with the devil.... [SEP] the number of [SEP] + +===== sample 047 ===== +[CLS] the end of a day, and it has to come well, not bad, but for many of these people who want to keep things together, it's because they do so well, or they just get their way, or even, of course, start your trip on the hot wheels. [SEP] but we have had a good marriage, lost our marriage to have a child, that if we'd still have a lot to work for, with the family, maybe, and love to him came out and he was a strong boy, he didn't have to give up. [SEP] but in the "hybrid" system, [SEP] + +===== sample 048 ===== +[CLS] much more room with water in their homes. [SEP] for a long time, it has something to do with our financial system. [SEP] " but i have no things to do in training, so when it gets to the task... i know well, i know in sport that i have to get into the training - session - and - fitness situations. [SEP] bristol crown court heard he often abused young people in a police car on occasions. [SEP] in addition, the yankees won seven games - - from 14 - 15 to - 6, going into the season - - in the same seasons 2006 and 2007. [SEP] and, he said [SEP] + +===== sample 049 ===== +[CLS]. [SEP] and a different kind of attitude. [SEP] he jumped into a concrete lot near the police checkpoint, and then began his way to catch the vehicle. [SEP] also, create a situation where you can look at the intensity of life going on, the movement of the water around you, and the light, then and then, once and then, and then, all on the lights with the sort of clarity. [SEP] i have heard that we do things we know so much, know about things we just say, about things - people, things they do not want to be said, are not always right. [SEP] finally, that ' [SEP] + +===== sample 050 ===== +[CLS] [SEP] and, while the man still has a more civil sense of authority, the promise of a greater sense of adventure has brought down a united force that he never seemed to be going on the best course at all. [SEP] for those at all levels, such as reading, gardening, water sports, food, work and clothes, the same could be done with free meals and holidays. [SEP] this one means being able to work day, work, in classes, weekends and other things, so you can sit for an hour, day, or hours, as well. [SEP] nope, dec. [SEP] the truth is this, i have to [SEP] + +===== sample 051 ===== +[CLS] in developing countries, according to us media reports. [SEP] it brought in a surplus of £17, 000, down from £16m in 2006. [SEP] he certainly is not like many of the day's events - - done in the 70s, 60s, or 70s - - or even 70s - - and for example, he wasn't ready to do anything. [SEP] he was a managing director for england's team - - which ran from one season until 2003 - - eight years before he had fully decided to be coming to london after a 10 - year run for the club in the early months of 2004. [SEP] but [SEP] + +===== sample 052 ===== +[CLS] figures seem to appear accurate, but the unemployment rate is less than 3 percent. [SEP] the committee's chairman, james schwi, was added to the committee. [SEP] "we have some time, and i have to get a bit extra, to be ready, get up and something else." [SEP] and j. d. scored a single on chicago's first pitch of the inning to take a 4 - 3 run, the one that eventually forced comebacker joe scuier out of position to end a perfect game. [SEP] the union issued a warning that foreign workers and the prime minister have the right to use their [SEP] + +===== sample 053 ===== +[CLS] and easier for people to give. [SEP] that, not just, in its words, but also its 2, 000 - pound capacity, a permanent one that doesn't break, and can return in "another 20 years." [SEP] and for a while, i'm not sorry about you, i'm love with you, when people have good things, but we don't know. [SEP] its shares have lost more than 10 %. [SEP] "i think i think there are a lot of people on the team and my head doesn't look like, but it really is really much more important," said brian [SEP] + +===== sample 054 ===== +[CLS] happened in the months and months, and to all of them, time by time. [SEP] nature, faith and god, has a great deal of regularity, but there is little to do with man's relationships, he said. [SEP] a man, man, woman, a dog, i say, don't get a job, have a mortgage, good hands, bad heart. [SEP] axa is the global software company that provides more than 40 years of data service to global clients. [SEP] he had been on the run in australia before, and in march 2008, was arrested and released by australian police. [SEP] a similar [SEP] + +===== sample 055 ===== +[CLS]her al murktari, who was sent to the uk 11 days after the 9/11 attacks on the us states. [SEP] i know, after 3 years, i should have stopped. [SEP] after that, i has to deal with mid - term issues. [SEP] it's a situation. [SEP] the jets' top - receiver was suspended, and replaced him again. [SEP] "japan is beautiful, but it is beautiful," he said. [SEP] this is the stock market crash of 2008. [SEP] a self - proclaimed graduate of politics. [SEP] on a recent day, members of the group said support, no words, no [SEP] + +===== sample 056 ===== +[CLS]. [SEP] the family is rarely in crisis. [SEP] a lot of it means money - - which means, well, done, a lot of folks were able to give you the best idea of everything - - in the class. [SEP] he was freed in 2002. [SEP] at the end, she's at the point who comes back in the face of, i have to say, "bad girl" - - "the love girl" that always gets thrown at her feet, almost always on stage - - and suddenly has a bit of talent. [SEP] it's not necessarily to do with a guy who's superior, and [SEP] + +===== sample 057 ===== +[CLS] half, before he finally grabbed a 16 - point lead in cleveland's win - - 80 - 73 victory. [SEP] the crew then walked out of the back room, and the 20 - year - old used a window door to get back to their seats. [SEP] however, the local authority which responded to the petition decided it had not been given back to creditors - which was for a total of £36m. [SEP] not that "the old man" is its nemesis. [SEP] think more about your answers, because there are answers you really need, and even later in the end you have a plan. [SEP] " i have a [SEP] + +===== sample 058 ===== +[CLS]on, dallas rivers, willie johnson, the all - star wide receiver, and all - pro receivers. [SEP] he was taken from his hospital car to a nearby police car, moments before the prison closed, he said in a statement. [SEP] obama had a boost. [SEP] so in the week of february, 17 of the biggest u. s. banks, and 7. 7 percent was nationwide. [SEP] so, i gave in to my son and have to have to do so for all he was to help them. [SEP] the company first made a breakthrough in 2002 when the company, an insurance company, finally built a small hospital in [SEP] + +===== sample 059 ===== +[CLS] "he is a quiet person," mr. crowley says, seeming to write, at the minimum, a letter to u. s. ambassador to the house. [SEP] "i'm not inclined to say my friends are doing the thing," obama said. [SEP] however, he's not coming back to the championship. [SEP] the spokesman said that it was likely that the cap, which usually includes tax increases below 2 % for drivers, included the average price of 10 per cent. [SEP] and i have to work out and understand it. [SEP] the angels played a game in baseball for the first time in 14 years. [SEP] [SEP] + +===== sample 060 ===== +[CLS] u. s., and canada. [SEP] just like ours, you can help you live better. [SEP] and i know they are well into the last seven. [SEP] since the snowboarding show opened in its entirety in 7 - 11, 2004, the peninsula hotel has been building up its own ski area for years. [SEP] they call for an investment bank to supply cash, which consumers should be able to repay at any time prior to the financial crisis. [SEP] we expect to sleep for an hour in the office, sometimes in a couple of minutes. [SEP] the purchase had been successful, he said, but from £5, 500 to [SEP] + +===== sample 061 ===== +[CLS] after six years of "shelling." [SEP] but officials say the black list could take the flight within three to five months of the target and that it has refused to have flights until friday. [SEP] he has, sometimes,, stories, stories, words, and a tendency to describe the feelings or things that have ever gone on in an instant - - and to the mixture of whole foods, real experiences, thoughts, feelings, and so deep in our blood that one, or another, is just as visible, even untimely, here. [SEP] here, head and mouth, on top of a black - covered mask. [SEP] + +===== sample 062 ===== +[CLS] council spokesman bob davies said: " the first (and practical) thing young people have to do is look for themselves. [SEP] that is what the majority leader, mr cameron, or mr brown, believes. [SEP] la angels at chicago, 8: 15 p. m. [SEP] send a message, a wink, a response. [SEP] u. s. and british officials in baghdad insist the government is prepared to make a massive effort to keep these areas operating, according to military officials, including a letter to the official. [SEP] unite, which employs 400 teachers, reports from its members at least two hours a day, and employs around 22 [SEP] + +===== sample 063 ===== +[CLS] services. [SEP] "john mccain is going to have to lose for us, and he is, and we will never have the chance to run for the senate," romney told cnn's website. [SEP] in order to choose from his color - - his loose - toped, cotton - out pants - - he has to open his own, even when he really warms. [SEP] so in spite of that, we have a lot to do... [SEP] because of the fact i was a public teacher. [SEP] i figured he got on the screen he'd not feel for a long time. [SEP] not surprisingly, the [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/state_c256_t1p45_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/state_c256_t1p45_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..46f83b5ba4da46be870215c52b9f7908042e50c0 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/state_c256_t1p45_raw_samples.txt @@ -0,0 +1,228 @@ +state_c256_t1p45 +{ + "type": "summary", + "name": "state_c256_t1p45", + "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", + "step": 124000, + "decode": { + "kind": "categorical_fullvocab", + "config": "state_c256_t1p45", + "steps": 64, + "model_t_mode": "post", + "support_power": 1.0, + "semantic_power": 1.0, + "endpoint_temp": 1.45, + "concentration_min": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 42.24168306980635, + "nll_per_token": 3.7434074840068114, + "tokens": 9506 + }, + "diversity": { + "sample_entropy": 4.010304198715844, + "unique_tokens": 1579, + "token_count": 8192, + "distinct_1": 0.1927490234375, + "distinct_2": 0.6353346456692913, + "top_token_mass": 0.0780029296875 + } +} + +===== sample 000 ===== +[CLS] said earlier that it had no plans for the plans, but said they wanted to close the project. [SEP] " there ' s also a need to maintain a base rate cut of 15 per cent to the level of the government ' s plan, " he said. [SEP] they had been given a 45 minutes to respond in the middle of that match. [SEP] how about the iphone? [SEP] however, at & t believes the austere is over. [SEP] you have paid a few days to get the money, and this is not the manager ' s idea - - it ' s not true. [SEP] you can see a piece of the [SEP] + +===== sample 001 ===== +[CLS] - - it has to deliver power for no more than 90 minutes. [SEP] add it and leave it up, gently, then half - covered, in less than a minute, in my case. [SEP] it is just around the time we get to the old obama - style relationship, and when he is really ill, he takes in the air and takes him to do some of teddy ' s better work. [SEP] the answer is to think that, if it ' s your flight, the world will know : maybe you have to do it and more likely to know how to do it. [SEP] 2.... [SEP] he, [SEP] + +===== sample 002 ===== +[CLS] when it goes into bankruptcy and - - no more than $ 50m - - the damage proceeds, and ends with a bond to repay. [SEP] but, eventually, the colts managed to provide a much - needed run. [SEP] in a autumn afternoon, up a mile from the airport, the wheels of the car are off. [SEP] numbers 6, number 3, 6, 7, 4, and 5 - 601. 5. based on the nature of their organization. [SEP] then, it becomes much smaller - - even more so. [SEP] " we hope they have to learn, and they know where there was that time, " [SEP] + +===== sample 003 ===== +[CLS] back in the first place - - a phenomenon known as academic genius - - as well as stretching the whole way back to 1974. [SEP] ( ap ) - - a student trying to remember a child ' s identity is, perhaps, a valuable, overthrown thing, if you can ' t buy this kind of piece of background music. [SEP] it is very sad. [SEP] the current, self - righteous leader is their current leader, a tenacious, self - centered, morgenist cult that has no sense to believe in. [SEP] and a whole lot of them on the edge of the field in a huff - - [SEP] + +===== sample 004 ===== +[CLS], including bi - oil, salt and flour, in food and water. [SEP] they will face their countries, who have had more success than in 2008. [SEP] and nothing, and nothing. [SEP] there to have a bit of work to do, be good, go home, be a good date, come, have a good day. [SEP] you have to just cook constantly, bring in butter and water, then place the butter in the pan, add pieces and boil the butter. [SEP] " but when you work with the people, i will bring him together with the leader, you have to have lots of views. [SEP] instead, [SEP] + +===== sample 005 ===== +[CLS], and others. [SEP] we ' ll go back and you, the children, keep getting in, school, maybe, maybe, they can, but come up early. [SEP] the former senator, of san diego, california, still knows enough to get home with him. [SEP] today, most of them actually figure in short stories. [SEP] during seven years in the organization, she never lost her life, " he said, sitting in the studio for a week. [SEP] north american tile designs are modular and modular parts - - they are bigger and better than - metal equipment - - components, manufacturing, and equipment from all angles, from [SEP] + +===== sample 006 ===== +[CLS]. m. [SEP] in these economic situations, you can use conventional security on a flight to check the bag, and bring it in order - - ready to carry up one side - - to the airport. [SEP] david baker, head of the highways agency, said that more than 10 % of staff were now due to work the town ' s full - time or temporary work day. [SEP] " that ' s awful and bad, especially to get and go down, " said garcey. [SEP] and the rules are so simple. [SEP] " for all who have been here for hundreds of years, don ' t think that even one [SEP] + +===== sample 007 ===== +[CLS]. [SEP] she told him he was what he did, and then he got into his own seat. [SEP] if i can work for more than a year.... and that ' s my dream. [SEP] sure, if gays are born, there would have to be a president, so move on to that will and continue to serve. [SEP] the answer is one of the same things. [SEP] " he is pretty, young, very talented and led his team in the super bowl. [SEP] he agrees with his father ' s words. [SEP] to some, that has never been quite long - - since he was his schoolboy [SEP] + +===== sample 008 ===== +[CLS]ed by britain ' s taste for cash. [SEP] the bidding process is also due in early 2010. [SEP] d. a. ' s refine and clothe material injects large layers of light - - in the smalls of the magnets, a much bigger 12c away, and in the vacuum it is now possible to build up a series of heat tubes, working through the floor that makes them look similar in size to the so - called light - ray 15c. [SEP] 25 - 25 2007. [SEP] however she was only three days on a leave, and up to three hours on a waiting list. [SEP] the [SEP] + +===== sample 009 ===== +[CLS], i spent much of the day looking for a solution. [SEP] they saw the tarp from the ceiling and saw a picture of the animal. [SEP] then she began to do the same in the french embassy, where she worked. [SEP] the vatican has also said it will not comment on the shooting. [SEP] the show took between everything - - in planes, blankets, sometimes in the space of days, but sometimes in the combination of food, water, water and sleep - - and between 100 and 100, 000. [SEP] the israeli leader, at home in mumbai, said that it would take a lot of time. [SEP] he is [SEP] + +===== sample 010 ===== +[CLS] reporting in london, england ; contributed reporting from beijing. [SEP] ap writer tom mclachler in jackson, miss, and steven esher in washington contributed to this report. [SEP] however, i like the big shift in london. [SEP] in advance of the second world war in italy, the u. s. military appeared to function in the province, whose total u. s. presence was about 3, 000 during its occupation in the united states. [SEP] to avoid that, the u. s. has to extend the foreign combat period to a minimum of 10 weeks before leaving for 60 days. [SEP] and in other hand, the [SEP] + +===== sample 011 ===== +[CLS] making it up, then, instead of a 10 - year plan to finish a full - year career. [SEP] the toaster ' s costs ( $ 364, including a person ) for two four - course cabets, a small package from 20, 000 swiss francs ( $ 50, 000, £377 ). [SEP] the planes will be kept in operation until a full period and working for two weeks. [SEP] ( cnn ) - - you like to work day a day for the next week. [SEP] it could be a joke. [SEP] the rebound in its value will further come as companies try to cope with the current turmoil [SEP] + +===== sample 012 ===== +[CLS] to take time to answer a very complex question. [SEP] he and the others sat together for several minutes, all three seemed to show any emotion in the middle of their lives. [SEP] the whole scandal is the biggest lob of pakistan ' s history. [SEP] then i got on the bus. [SEP] i walked, stepped into the tunnel and saw the good old men, and i did, smack something into my heart. [SEP] james gafiz, a spokesman at the embassy in the capital was unable to be reached. [SEP] for a while he can finally admit that he needs to have a little time at work. [SEP] that way, [SEP] + +===== sample 013 ===== +[CLS] [SEP] there is a way between seeing, say, the stories of patients and their children this summer, but one, i will remember, at the end of the day when doctors seem to understand that others have been brought up, that there is always the look and the look of a person, who is always going up together. [SEP] mr brown said that over the years we have learned a lot about the future of education, something that has been lost in hard times. [SEP] " if we get the money, continue to lend... to the federal government for its budget, we can keep the money for a year to come. [SEP] + +===== sample 014 ===== +[CLS]. [SEP] but the police are " throwing their best " at sir brown, who said, " not a murderer. " [SEP] the state would need a further 1, 000 tonnes of cash to be invested in it. [SEP] the best way to bring my seat is a couple of days of paper, i ' ve gone to days, not days, days, days, not days. [SEP] " it will be a very tough week to be so close and final. " [SEP] harman said that even if they had a decent plan, repairs were ongoing. [SEP] he would like to have the opportunity. [SEP] the u. s. government [SEP] + +===== sample 015 ===== +[CLS] but given that people have so much power, they must be able to give it a lift, so i would think about it. [SEP] our system seems to run information on the right side in each of our desks, just as the computer just puts it in a drawer and takes it off. [SEP] in addition, multi - forces, in particular, are the result of a number of activities, including various programs to develop ground - to - ground control systems to support operations, security control systems, vehicle - control systems, control and navigation systems for all types of vehicles, and a circuiting system to effectively move the sort of information [SEP] + +===== sample 016 ===== +[CLS] s name. [SEP] it ' s not true, though. [SEP] at the other end of the scale you don ' t see at the start, and, at the top end to the end, you turn to the front and back. [SEP] he will take out the look of the basics : pillows, linens, linens, linens, linens, fire - air chairs, and pillows. [SEP] also, an old person is willing to accept the pressure of taking months off to get the job. [SEP] " the city is completely clean but i would be able to stay in this place, " said the opposition leader. [SEP] [SEP] + +===== sample 017 ===== +[CLS] to have a relationship with the other. [SEP] fris is known for being a business lawyer. [SEP] an even larger crowd - - 2, 400 students and 5 teachers - - attended the program in august, and now that costs $ 12 - - at a cost of $ 2, 500 - - to attend. [SEP] " we want to win but now, we ' re going to take some of us to get here. [SEP] he is also an avc politician, in describing such words as " white nationalism " and " racial nationalism. " [SEP] he also claims that the control in local government starts with " cuts, " according to [SEP] + +===== sample 018 ===== +[CLS] [SEP] he, he said, falls on his feet and refuses to drop dead. [SEP] london ( ap ) - london ' s index of leading shares jumped to record levels and reached 50 points, closing below 17. 2 on friday. [SEP] " as much as a true person, you can think, you will do the job and, ultimately, will have to give a bit of thought to the truth. [SEP] " the people know that the desire to help me achieve further work is no secret, he says. [SEP] in january, the council issued a road plan in the area of chap thurp, the most famous architect. [SEP] + +===== sample 019 ===== +[CLS] thursday. [SEP] i want to lie, or be self - deprecating, about the relationship. [SEP] the children had taken care of the bedroom. [SEP] some of the students are said to have been democrats from the tory party, and some of them admitted, in the end, the terms of their agreement were only a matter of a matter. [SEP] it ' s time to sit in and get out in the back of the car. [SEP] but for a brief moment, we stopped his car from the other side of the road and we, just a mile away, were taking most of the journey. [SEP] here, you know, [SEP] + +===== sample 020 ===== +[CLS] in new york. [SEP] the building company plans to bring its 300 employees to the b. r. s. from 16, 300 - seat aircraft and 16, 000 - 16, 500 aircraft during the second world war ii. [SEP] the problem is that, as well as having the wheel right, and holding it to the same side of tracks, the electric train then turns back, three or later, between steps and ramps, when it is to have to turn a place before the road ends. [SEP] obama is returning from his presidential campaign in texas on saturday. [SEP] look, now and then.... [SEP] however, the [SEP] + +===== sample 021 ===== +[CLS] ' t think it was difficult to make it a part of the business, " said mark morris, head of research strategy at bg & markets in india. [SEP] he said he is prepared to come here in a " more relaxed, more stable, mood in manchester for a while. " [SEP] the deadline is nov. [SEP] " i have to believe that the various apparent problems associated with the establishment of the rail commission haven ' t connected to any crime. [SEP] " the change is that people have family, friends, and people who always see that kind of day as a time for change, " he didn ' t say. [SEP] [SEP] + +===== sample 022 ===== +[CLS] the year... [SEP] on the other hand, the house is filled with the art and light, the light and light, the spouting of skin, the huge lemon - scented green and white, filled with giant trees and pinks. [SEP] after some years of baking on the ground, a deep yellow sweeter, which - - the deep red, brown sugar, and the smell of peppery water - - ended with salted water. [SEP] in addition, carmakers are printed with red red ink and make long brown paper. [SEP] " a few months later, someone went in to put out a special effort in [SEP] + +===== sample 023 ===== +[CLS], he was much younger and kind. [SEP] that made all the difference. [SEP] his lawyer, david patterson, said that he had been on the plane, but had refused to leave. [SEP] mr phillips said it is not his responsibility for the women to talk. [SEP] then there will be nothing worse. [SEP] the sale, with a residual value of $ 1. 6 million, until 2010, with a loss reduction of at least $ 500 million, is expected, brokers say. [SEP] as the battle got out, i began to look nonpollenty. [SEP] " it has never been a small operation, and the results of [SEP] + +===== sample 024 ===== +[CLS] to do. [SEP] ms robinson, who has asked mr robinson to become the minister, said yesterday that the parties entered into a second agreement, with the first minister, days after the issue was agreed in november 2007. [SEP] it ' s a combination of opportunities, many games, long, hard relationships. [SEP] in the end he took a lot of hurt. [SEP] they will make friends when he ' s in the house, she said. [SEP] mr mccafe, microsoft ' s business manager, pulls down a " note " about it, taking it like a dead end. [SEP] " we have not had a car in the past [SEP] + +===== sample 025 ===== +[CLS] to produce data. [SEP] " they ' ll be able to hire, hire, to hire, dress and hire. - - plus, the group will get enough money to do in the future, he said. [SEP] i mean everything, but for obama who wants to run a vote for a woman, look forward and vote for men and women. [SEP] and now that everything looks for sale, of course, it is like a go - between. [SEP] we want to work together. [SEP] he said he didn ' t speak about that. [SEP] they need to make a statement. [SEP] madison, wis., june 30 ( up [SEP] + +===== sample 026 ===== +[CLS], then come with them, after all, " he says. [SEP] and, the answer is, but, pretty simple. [SEP] people will need to build their egos on their own, and be the one to work in the mud and obliate them and put them together in order to make that thing happen. [SEP] david letterman, the former reality - show host, agrees. [SEP] he said the fans would continue to do his best to succeed. [SEP] they put me out of here. [SEP] but it is going to be. [SEP] i look at the city as well as i do in the city, " he said. [SEP] + +===== sample 027 ===== +[CLS] and a little more. [SEP] top of the mutton. [SEP] " now the definition of the problem is clear, " he said. [SEP] the group, which has been lobbying against the plan for the first time as recently as september, had not announced its final numbers. [SEP] the man, in a wheelchair, unable to cover his skis, cuts to the back and side of his head, was able to close the man. [SEP] but i ' m not a gooder. [SEP] i just read that one of the other ' s brothers died in bed when he had died. [SEP] it is not that this has surprised me. [SEP] + +===== sample 028 ===== +[CLS] interest in northern pakistan, " he said. [SEP] it was the first time al - marri had been hurt. [SEP] 2 ) the road was closed off and tied to the same wall. [SEP] he grew up, he said he was a great boy, and he came back from a couple of years on radio. [SEP] he called for the trains to start from home to the site because of the delay. [SEP] however, every day i get something to go on, it has to look all over me, so now i could really get a look on the face. [SEP] he can do what ' s right down to the north. [SEP] + +===== sample 029 ===== +[CLS] airport. [SEP] the overall use of european powers on the internet is a blow to the eu and the countries will find it harder to work together if they are to get any traction. [SEP] new york ( ap ) - - with the political jam settled, the evidence is bleak, but some experts say there ' s still a long way to go. [SEP] and if it is enough to do that - - eventually, the law will change. [SEP] there are two plastic bags on them - - chairs, linens and towels at one end of the head, one paper at the other, another on the outside of the pillow, the inside [SEP] + +===== sample 030 ===== +[CLS] at the time, so she called the police department in hopes of getting her kids back. [SEP] a _ detroit 2 of 2, chicago 1. [SEP] i always remember that again there was a lot - - pain, of a half - deep, sleep, half - force fatigue, the deep pain, the failure to realize that there was some of these issues to be resolved. [SEP] he opened his eyes, but returned for a few seconds before the full picture was shown to him. [SEP] that is, admittedly, the level of such assertions. [SEP] he has a bit to prove. [SEP] i can see that the attitude is [SEP] + +===== sample 031 ===== +[CLS] " you need to believe that a game of life and i has so far let that go, " he said. [SEP] he got on with him and his girlfriend, and both of them. [SEP] phoenix 24, boston, watson 24 ( new york 24 - - chicago 2, detroit 19, chicago 2 - brown 2 - 2 ). [SEP] the night, off - time, late in the night, i didn ' t... [SEP] to keep to a good touch with the dog, they have to pretend that the dog is simply working, not working, but is making it in the wild. [SEP] " and that means that [SEP] + +===== sample 032 ===== +[CLS] tell him that there is a lot of pressure at the top of the road. [SEP] the only time he was elected was two years ago, when he said that, according to an analysis by a military tribunal, he had little in his system to try. [SEP] the knicks ' agreement with vick marks a new chapter in the days of the jets ' current owner - - willie walsh - - along with a multi - year deal. [SEP] while the chef was on my own, i would stay there full time - - until he left, perhaps, later, with the whole room filled with white linen. [SEP] while it helps that the [SEP] + +===== sample 033 ===== +[CLS] the lead on a 6 - 2 run early in the quarter. [SEP] in chicago, executives from cbs group inc. picked up the tag with him, and he ' s expected to appear in the event at the center of the museum. [SEP] but all of them are thought to be having to work out a number of layers of salt, ice and placity - - the coast, mountain roads and even roads, trains, trains, railway stations, and the metropolitan area - - before to be exposed to the snow. [SEP] bring in everything - - top, buttery, pan - cover and vanilla - mix with salt, and [SEP] + +===== sample 034 ===== +[CLS] season. [SEP] the half - mile will bring in about 1, 000 in july, with the use of four cars on the manchester and liverpool roads. [SEP] the plan was no insurance option. [SEP] bring boil, low heat, wash - water to boil, or, as much as possible, make it into a large bowl. [SEP] and then, finally, it is, in the long ahead, a more expensive name. [SEP] but we ' ve got him in your corner. [SEP] where is anyone going for the white house. [SEP] i think, really, that makes it look much better. [SEP] only 11. 30am : we [SEP] + +===== sample 035 ===== +[CLS] " the group ' s mark steel said. [SEP] get back to work, then start to the back of the union. [SEP] but take off in a taxi, get to london and get to london - the train is more, not less. [SEP] when he said that the violence happened, he was only allowed to talk again, and pointed to a point where she lied. [SEP] he and ba tried to put a sign on the flight, and there is some confusion about those details. [SEP] a few bubbles - - in place, a pinch of butter and, often, in it - - sat at the bottom of the fridge. [SEP] [SEP] + +===== sample 036 ===== +[CLS] up, it does not make much sense, " ocampo told afp. [SEP] " and in the meantime, said his wife,,, c.,,,,,,,,,,,,,,,,,,,,,, on the top of the middle of the table, and on the back in the middle of the room, but the whole time was still around s. 5 as the light fell. [SEP] they are part of a lot when you need to do in a company by being a coach, but with listening in person and sitting in person. [SEP] the uk is one of [SEP] + +===== sample 037 ===== +[CLS] want to enjoy. [SEP] on wednesday, obama and obama have to work over their ideas, together to work together and to work on the same. [SEP] the white house will not respond to any decisions in six months, " he said. [SEP] you can work, in turn, and cook together in some flour ( or liquid ) to try to balance the juices. [SEP] the difference is that hard to understand, that people must be able to voice that message. [SEP] " with a coach, the time is, once or even twice, take off, " he said. [SEP] the deal, however, was to close in october, [SEP] + +===== sample 038 ===== +[CLS], " he said. [SEP] you just have to take it off, he can buy a pair of long - lasting pants. [SEP] the world should have tried to wait, but by now we were hoping for the worst. [SEP] we love you, with great boos, and lots of boos ; i mean, if your answer is short, " yes. " [SEP] the difference narrowed. [SEP] and, hey, there ' s a moon. [SEP] now, that veteran needs to leave and turn again - - and he will have to wait to pass this season - - back. [SEP] but he is getting into the green ground in [SEP] + +===== sample 039 ===== +[CLS] 80 percent of the equivalent of 100 million yuan in value, " he said. [SEP] the company has cancelled flights in the last week and expanded to 12 hours and 48 hours a day over a seven - day - week and 14 day period over the past five years. [SEP] you ' ll also see a look of the first two performances, prior to the play in 14 minutes. [SEP] the old dresses, dressed anonymously as black dresses, was knotted together, teetering along the walls on a sheet lined with white coats strung together in a heavy yellow blanket. [SEP] the capitals ' s streak began a year after the game, with the [SEP] + +===== sample 040 ===== +[CLS] - he ' s only one person. [SEP] the historic 7 - 2 victory put the broncos in the same playoffs for the first time since 1991 - - and the first in franchise history. [SEP] when it was presented to the audience, changes to the story, i thought, were something of a flurry of drama, and, crucially, all of the talk said, that it was never the name of the opera house. [SEP] place the butter in the pars, and leave the butter in the oven, stirring in the pans, and lay the onion together in the pan. [SEP] the falcons are waiting for a review. [SEP] + +===== sample 041 ===== +[CLS] - t :... hi, i want to work in iran. [SEP] the trail features 10 men in skis able to run hundreds of miles, in within miles and in minutes. [SEP] they can, in other words, drive you back to the top - down destination for a while - - the same right out of the sun. [SEP] they had the risk of death. [SEP] unfortunately, though, he didn ' t realize, even the traditionalists, that he did so at all. [SEP] " the world economy is trying to recover, but things can be much worse, " he said. [SEP] for the second quarter of [SEP] + +===== sample 042 ===== +[CLS] of god, to his work as a lawyer, and as a grunder. [SEP] what a shame for me, and i would glad to have a new friend from north korea with a great bit of help at work if you want to look in the mirror just a little. [SEP] 40 and 30 - year - old artists - - who have been able to see the local works on so much of their short story lines - - are gone, he said. [SEP] if you want to vote, you have...... od7 dww albyn2rxwb i arrived just before the [SEP] + +===== sample 043 ===== +[CLS], we ' ve made a lot of other progress. [SEP] we were all leaving at the other end of the tunnel, but when we spoke they were terrified at the prospect of having to move. [SEP] mr brown is accused of having " a huge attack " on his daughter after he drank alcohol. [SEP] i knew when he was 20, the equivalent of a ball - - and maybe a card - - and a good tool to get the ability to control the ball - - but that just was going to be his hand. [SEP] " we can never get a divorce - - and we ' re still married, " said. [SEP] he [SEP] + +===== sample 044 ===== +[CLS] his way back to the penalty area. [SEP] with the opening of its facility, the dc / b / f - series, b - 8, mdc technologies is a leader in confill solutions for advanced high - powered, land - based power systems. [SEP] before you do, forget to feel in a daze - - it can mean through the top of the wall, just before you touch it at the side of the wall. [SEP] they don ' t know that, when the story just comes together, then, change at the bad times, then, maybe, then again, and it ' s back in the black. [SEP] + +===== sample 045 ===== +[CLS] august last year. [SEP] so, to come out, at the road, at the down, at the ground, at the side, to at the door, to get the door, at the back end of the turn, on a path, and we are going back down, we are already able to stop and to have a reverse journey up there, just to work again... and he seems to have a path with a path that is out of the end of the starting point. [SEP] " the children are in the class, and well, half our children. [SEP] the airline will be able to pay as much as [SEP] + +===== sample 046 ===== +[CLS] of anything he ' s ever said to him, and that ' s true. [SEP] here there are differences in the two - state relationship. [SEP] he says he is " very self - functioning. " [SEP] i will try to get into this way... [SEP] their victory resulted in the best start of the day. [SEP] in the end, it seemed to be a film that went far in its direction and, to some extent, nothing less than a political special. [SEP] mr. brown talks about the results. [SEP] it is, it ' s right, the droves with the devil.... [SEP] the number of [SEP] + +===== sample 047 ===== +[CLS] the end of a day, and it has to come well, not bad, but for many of these people who want to keep things together, it ' s because they do so well, or they just get their way, or even, of course, start your trip on the hot wheels. [SEP] but we have had a good marriage, lost our marriage to have a child, that if we ' d still have a lot to work for, with the family, maybe, and love to him came out and he was a strong boy, he didn ' t have to give up. [SEP] but in the " hybrid " system, [SEP] + +===== sample 048 ===== +[CLS] much more room with water in their homes. [SEP] for a long time, it has something to do with our financial system. [SEP] " but i have no things to do in training, so when it gets to the task... i know well, i know in sport that i have to get into the training - session - and - fitness situations. [SEP] bristol crown court heard he often abused young people in a police car on occasions. [SEP] in addition, the yankees won seven games - - from 14 - 15 to - 6, going into the season - - in the same seasons 2006 and 2007. [SEP] and, he said [SEP] + +===== sample 049 ===== +[CLS]. [SEP] and a different kind of attitude. [SEP] he jumped into a concrete lot near the police checkpoint, and then began his way to catch the vehicle. [SEP] also, create a situation where you can look at the intensity of life going on, the movement of the water around you, and the light, then and then, once and then, and then, all on the lights with the sort of clarity. [SEP] i have heard that we do things we know so much, know about things we just say, about things - people, things they do not want to be said, are not always right. [SEP] finally, that ' [SEP] + +===== sample 050 ===== +[CLS] [SEP] and, while the man still has a more civil sense of authority, the promise of a greater sense of adventure has brought down a united force that he never seemed to be going on the best course at all. [SEP] for those at all levels, such as reading, gardening, water sports, food, work and clothes, the same could be done with free meals and holidays. [SEP] this one means being able to work day, work, in classes, weekends and other things, so you can sit for an hour, day, or hours, as well. [SEP] nope, dec. [SEP] the truth is this, i have to [SEP] + +===== sample 051 ===== +[CLS] in developing countries, according to us media reports. [SEP] it brought in a surplus of £17, 000, down from £16m in 2006. [SEP] he certainly is not like many of the day ' s events - - done in the 70s, 60s, or 70s - - or even 70s - - and for example, he wasn ' t ready to do anything. [SEP] he was a managing director for england ' s team - - which ran from one season until 2003 - - eight years before he had fully decided to be coming to london after a 10 - year run for the club in the early months of 2004. [SEP] but [SEP] + +===== sample 052 ===== +[CLS] figures seem to appear accurate, but the unemployment rate is less than 3 percent. [SEP] the committee ' s chairman, james schwi, was added to the committee. [SEP] " we have some time, and i have to get a bit extra, to be ready, get up and something else. " [SEP] and j. d. scored a single on chicago ' s first pitch of the inning to take a 4 - 3 run, the one that eventually forced comebacker joe scuier out of position to end a perfect game. [SEP] the union issued a warning that foreign workers and the prime minister have the right to use their [SEP] + +===== sample 053 ===== +[CLS] and easier for people to give. [SEP] that, not just, in its words, but also its 2, 000 - pound capacity, a permanent one that doesn ' t break, and can return in " another 20 years. " [SEP] and for a while, i ' m not sorry about you, i ' m love with you, when people have good things, but we don ' t know. [SEP] its shares have lost more than 10 %. [SEP] " i think i think there are a lot of people on the team and my head doesn ' t look like, but it really is really much more important, " said brian [SEP] + +===== sample 054 ===== +[CLS] happened in the months and months, and to all of them, time by time. [SEP] nature, faith and god, has a great deal of regularity, but there is little to do with man ' s relationships, he said. [SEP] a man, man, woman, a dog, i say, don ' t get a job, have a mortgage, good hands, bad heart. [SEP] axa is the global software company that provides more than 40 years of data service to global clients. [SEP] he had been on the run in australia before, and in march 2008, was arrested and released by australian police. [SEP] a similar [SEP] + +===== sample 055 ===== +[CLS]her al murktari, who was sent to the uk 11 days after the 9 / 11 attacks on the us states. [SEP] i know, after 3 years, i should have stopped. [SEP] after that, i has to deal with mid - term issues. [SEP] it ' s a situation. [SEP] the jets ' top - receiver was suspended, and replaced him again. [SEP] " japan is beautiful, but it is beautiful, " he said. [SEP] this is the stock market crash of 2008. [SEP] a self - proclaimed graduate of politics. [SEP] on a recent day, members of the group said support, no words, no [SEP] + +===== sample 056 ===== +[CLS]. [SEP] the family is rarely in crisis. [SEP] a lot of it means money - - which means, well, done, a lot of folks were able to give you the best idea of everything - - in the class. [SEP] he was freed in 2002. [SEP] at the end, she ' s at the point who comes back in the face of, i have to say, " bad girl " - - " the love girl " that always gets thrown at her feet, almost always on stage - - and suddenly has a bit of talent. [SEP] it ' s not necessarily to do with a guy who ' s superior, and [SEP] + +===== sample 057 ===== +[CLS] half, before he finally grabbed a 16 - point lead in cleveland ' s win - - 80 - 73 victory. [SEP] the crew then walked out of the back room, and the 20 - year - old used a window door to get back to their seats. [SEP] however, the local authority which responded to the petition decided it had not been given back to creditors - which was for a total of £36m. [SEP] not that " the old man " is its nemesis. [SEP] think more about your answers, because there are answers you really need, and even later in the end you have a plan. [SEP] " i have a [SEP] + +===== sample 058 ===== +[CLS]on, dallas rivers, willie johnson, the all - star wide receiver, and all - pro receivers. [SEP] he was taken from his hospital car to a nearby police car, moments before the prison closed, he said in a statement. [SEP] obama had a boost. [SEP] so in the week of february, 17 of the biggest u. s. banks, and 7. 7 percent was nationwide. [SEP] so, i gave in to my son and have to have to do so for all he was to help them. [SEP] the company first made a breakthrough in 2002 when the company, an insurance company, finally built a small hospital in [SEP] + +===== sample 059 ===== +[CLS] " he is a quiet person, " mr. crowley says, seeming to write, at the minimum, a letter to u. s. ambassador to the house. [SEP] " i ' m not inclined to say my friends are doing the thing, " obama said. [SEP] however, he ' s not coming back to the championship. [SEP] the spokesman said that it was likely that the cap, which usually includes tax increases below 2 % for drivers, included the average price of 10 per cent. [SEP] and i have to work out and understand it. [SEP] the angels played a game in baseball for the first time in 14 years. [SEP] [SEP] + +===== sample 060 ===== +[CLS] u. s., and canada. [SEP] just like ours, you can help you live better. [SEP] and i know they are well into the last seven. [SEP] since the snowboarding show opened in its entirety in 7 - 11, 2004, the peninsula hotel has been building up its own ski area for years. [SEP] they call for an investment bank to supply cash, which consumers should be able to repay at any time prior to the financial crisis. [SEP] we expect to sleep for an hour in the office, sometimes in a couple of minutes. [SEP] the purchase had been successful, he said, but from £5, 500 to [SEP] + +===== sample 061 ===== +[CLS] after six years of " shelling. " [SEP] but officials say the black list could take the flight within three to five months of the target and that it has refused to have flights until friday. [SEP] he has, sometimes,, stories, stories, words, and a tendency to describe the feelings or things that have ever gone on in an instant - - and to the mixture of whole foods, real experiences, thoughts, feelings, and so deep in our blood that one, or another, is just as visible, even untimely, here. [SEP] here, head and mouth, on top of a black - covered mask. [SEP] + +===== sample 062 ===== +[CLS] council spokesman bob davies said : " the first ( and practical ) thing young people have to do is look for themselves. [SEP] that is what the majority leader, mr cameron, or mr brown, believes. [SEP] la angels at chicago, 8 : 15 p. m. [SEP] send a message, a wink, a response. [SEP] u. s. and british officials in baghdad insist the government is prepared to make a massive effort to keep these areas operating, according to military officials, including a letter to the official. [SEP] unite, which employs 400 teachers, reports from its members at least two hours a day, and employs around 22 [SEP] + +===== sample 063 ===== +[CLS] services. [SEP] " john mccain is going to have to lose for us, and he is, and we will never have the chance to run for the senate, " romney told cnn ' s website. [SEP] in order to choose from his color - - his loose - toped, cotton - out pants - - he has to open his own, even when he really warms. [SEP] so in spite of that, we have a lot to do... [SEP] because of the fact i was a public teacher. [SEP] i figured he got on the screen he ' d not feel for a long time. [SEP] not surprisingly, the [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/state_c256_t1p45_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/state_c256_t1p45_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..6a71bfd33fabbd2b2ddb07ccb3db6f39ec15d542 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/state_c256_t1p45_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "state_c256_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c256_t1p45", "steps": 64, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 42.24168306980635, "nll_per_token": 3.7434074840068114, "tokens": 9506}, "diversity": {"sample_entropy": 4.010304198715844, "unique_tokens": 1579, "token_count": 8192, "distinct_1": 0.1927490234375, "distinct_2": 0.6353346456692913, "top_token_mass": 0.0780029296875}} +{"type": "sample", "index": 0, "raw_text": "[CLS] said earlier that it had no plans for the plans, but said they wanted to close the project. [SEP] \" there ' s also a need to maintain a base rate cut of 15 per cent to the level of the government ' s plan, \" he said. [SEP] they had been given a 45 minutes to respond in the middle of that match. [SEP] how about the iphone? [SEP] however, at & t believes the austere is over. [SEP] you have paid a few days to get the money, and this is not the manager ' s idea - - it ' s not true. [SEP] you can see a piece of the [SEP]", "detok_text": "[CLS] said earlier that it had no plans for the plans, but said they wanted to close the project. [SEP] \"there's also a need to maintain a base rate cut of 15 per cent to the level of the government's plan,\" he said. [SEP] they had been given a 45 minutes to respond in the middle of that match. [SEP] how about the iphone? [SEP] however, at & t believes the austere is over. [SEP] you have paid a few days to get the money, and this is not the manager's idea - - it's not true. [SEP] you can see a piece of the [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] - - it has to deliver power for no more than 90 minutes. [SEP] add it and leave it up, gently, then half - covered, in less than a minute, in my case. [SEP] it is just around the time we get to the old obama - style relationship, and when he is really ill, he takes in the air and takes him to do some of teddy ' s better work. [SEP] the answer is to think that, if it ' s your flight, the world will know : maybe you have to do it and more likely to know how to do it. [SEP] 2.... [SEP] he, [SEP]", "detok_text": "[CLS] - - it has to deliver power for no more than 90 minutes. [SEP] add it and leave it up, gently, then half - covered, in less than a minute, in my case. [SEP] it is just around the time we get to the old obama - style relationship, and when he is really ill, he takes in the air and takes him to do some of teddy's better work. [SEP] the answer is to think that, if it's your flight, the world will know: maybe you have to do it and more likely to know how to do it. [SEP] 2.... [SEP] he, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] when it goes into bankruptcy and - - no more than $ 50m - - the damage proceeds, and ends with a bond to repay. [SEP] but, eventually, the colts managed to provide a much - needed run. [SEP] in a autumn afternoon, up a mile from the airport, the wheels of the car are off. [SEP] numbers 6, number 3, 6, 7, 4, and 5 - 601. 5. based on the nature of their organization. [SEP] then, it becomes much smaller - - even more so. [SEP] \" we hope they have to learn, and they know where there was that time, \" [SEP]", "detok_text": "[CLS] when it goes into bankruptcy and - - no more than $50m - - the damage proceeds, and ends with a bond to repay. [SEP] but, eventually, the colts managed to provide a much - needed run. [SEP] in a autumn afternoon, up a mile from the airport, the wheels of the car are off. [SEP] numbers 6, number 3, 6, 7, 4, and 5 - 601. 5. based on the nature of their organization. [SEP] then, it becomes much smaller - - even more so. [SEP] \"we hope they have to learn, and they know where there was that time,\" [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS] back in the first place - - a phenomenon known as academic genius - - as well as stretching the whole way back to 1974. [SEP] ( ap ) - - a student trying to remember a child ' s identity is, perhaps, a valuable, overthrown thing, if you can ' t buy this kind of piece of background music. [SEP] it is very sad. [SEP] the current, self - righteous leader is their current leader, a tenacious, self - centered, morgenist cult that has no sense to believe in. [SEP] and a whole lot of them on the edge of the field in a huff - - [SEP]", "detok_text": "[CLS] back in the first place - - a phenomenon known as academic genius - - as well as stretching the whole way back to 1974. [SEP] (ap) - - a student trying to remember a child's identity is, perhaps, a valuable, overthrown thing, if you can't buy this kind of piece of background music. [SEP] it is very sad. [SEP] the current, self - righteous leader is their current leader, a tenacious, self - centered, morgenist cult that has no sense to believe in. [SEP] and a whole lot of them on the edge of the field in a huff - - [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS], including bi - oil, salt and flour, in food and water. [SEP] they will face their countries, who have had more success than in 2008. [SEP] and nothing, and nothing. [SEP] there to have a bit of work to do, be good, go home, be a good date, come, have a good day. [SEP] you have to just cook constantly, bring in butter and water, then place the butter in the pan, add pieces and boil the butter. [SEP] \" but when you work with the people, i will bring him together with the leader, you have to have lots of views. [SEP] instead, [SEP]", "detok_text": "[CLS], including bi - oil, salt and flour, in food and water. [SEP] they will face their countries, who have had more success than in 2008. [SEP] and nothing, and nothing. [SEP] there to have a bit of work to do, be good, go home, be a good date, come, have a good day. [SEP] you have to just cook constantly, bring in butter and water, then place the butter in the pan, add pieces and boil the butter. [SEP] \" but when you work with the people, i will bring him together with the leader, you have to have lots of views. [SEP] instead, [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS], and others. [SEP] we ' ll go back and you, the children, keep getting in, school, maybe, maybe, they can, but come up early. [SEP] the former senator, of san diego, california, still knows enough to get home with him. [SEP] today, most of them actually figure in short stories. [SEP] during seven years in the organization, she never lost her life, \" he said, sitting in the studio for a week. [SEP] north american tile designs are modular and modular parts - - they are bigger and better than - metal equipment - - components, manufacturing, and equipment from all angles, from [SEP]", "detok_text": "[CLS], and others. [SEP] we'll go back and you, the children, keep getting in, school, maybe, maybe, they can, but come up early. [SEP] the former senator, of san diego, california, still knows enough to get home with him. [SEP] today, most of them actually figure in short stories. [SEP] during seven years in the organization, she never lost her life, \" he said, sitting in the studio for a week. [SEP] north american tile designs are modular and modular parts - - they are bigger and better than - metal equipment - - components, manufacturing, and equipment from all angles, from [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS]. m. [SEP] in these economic situations, you can use conventional security on a flight to check the bag, and bring it in order - - ready to carry up one side - - to the airport. [SEP] david baker, head of the highways agency, said that more than 10 % of staff were now due to work the town ' s full - time or temporary work day. [SEP] \" that ' s awful and bad, especially to get and go down, \" said garcey. [SEP] and the rules are so simple. [SEP] \" for all who have been here for hundreds of years, don ' t think that even one [SEP]", "detok_text": "[CLS]. m. [SEP] in these economic situations, you can use conventional security on a flight to check the bag, and bring it in order - - ready to carry up one side - - to the airport. [SEP] david baker, head of the highways agency, said that more than 10 % of staff were now due to work the town's full - time or temporary work day. [SEP] \"that's awful and bad, especially to get and go down,\" said garcey. [SEP] and the rules are so simple. [SEP] \" for all who have been here for hundreds of years, don't think that even one [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS]. [SEP] she told him he was what he did, and then he got into his own seat. [SEP] if i can work for more than a year.... and that ' s my dream. [SEP] sure, if gays are born, there would have to be a president, so move on to that will and continue to serve. [SEP] the answer is one of the same things. [SEP] \" he is pretty, young, very talented and led his team in the super bowl. [SEP] he agrees with his father ' s words. [SEP] to some, that has never been quite long - - since he was his schoolboy [SEP]", "detok_text": "[CLS]. [SEP] she told him he was what he did, and then he got into his own seat. [SEP] if i can work for more than a year.... and that's my dream. [SEP] sure, if gays are born, there would have to be a president, so move on to that will and continue to serve. [SEP] the answer is one of the same things. [SEP] \" he is pretty, young, very talented and led his team in the super bowl. [SEP] he agrees with his father's words. [SEP] to some, that has never been quite long - - since he was his schoolboy [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS]ed by britain ' s taste for cash. [SEP] the bidding process is also due in early 2010. [SEP] d. a. ' s refine and clothe material injects large layers of light - - in the smalls of the magnets, a much bigger 12c away, and in the vacuum it is now possible to build up a series of heat tubes, working through the floor that makes them look similar in size to the so - called light - ray 15c. [SEP] 25 - 25 2007. [SEP] however she was only three days on a leave, and up to three hours on a waiting list. [SEP] the [SEP]", "detok_text": "[CLS]ed by britain's taste for cash. [SEP] the bidding process is also due in early 2010. [SEP] d. a.'s refine and clothe material injects large layers of light - - in the smalls of the magnets, a much bigger 12c away, and in the vacuum it is now possible to build up a series of heat tubes, working through the floor that makes them look similar in size to the so - called light - ray 15c. [SEP] 25 - 25 2007. [SEP] however she was only three days on a leave, and up to three hours on a waiting list. [SEP] the [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS], i spent much of the day looking for a solution. [SEP] they saw the tarp from the ceiling and saw a picture of the animal. [SEP] then she began to do the same in the french embassy, where she worked. [SEP] the vatican has also said it will not comment on the shooting. [SEP] the show took between everything - - in planes, blankets, sometimes in the space of days, but sometimes in the combination of food, water, water and sleep - - and between 100 and 100, 000. [SEP] the israeli leader, at home in mumbai, said that it would take a lot of time. [SEP] he is [SEP]", "detok_text": "[CLS], i spent much of the day looking for a solution. [SEP] they saw the tarp from the ceiling and saw a picture of the animal. [SEP] then she began to do the same in the french embassy, where she worked. [SEP] the vatican has also said it will not comment on the shooting. [SEP] the show took between everything - - in planes, blankets, sometimes in the space of days, but sometimes in the combination of food, water, water and sleep - - and between 100 and 100, 000. [SEP] the israeli leader, at home in mumbai, said that it would take a lot of time. [SEP] he is [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] reporting in london, england ; contributed reporting from beijing. [SEP] ap writer tom mclachler in jackson, miss, and steven esher in washington contributed to this report. [SEP] however, i like the big shift in london. [SEP] in advance of the second world war in italy, the u. s. military appeared to function in the province, whose total u. s. presence was about 3, 000 during its occupation in the united states. [SEP] to avoid that, the u. s. has to extend the foreign combat period to a minimum of 10 weeks before leaving for 60 days. [SEP] and in other hand, the [SEP]", "detok_text": "[CLS] reporting in london, england; contributed reporting from beijing. [SEP] ap writer tom mclachler in jackson, miss, and steven esher in washington contributed to this report. [SEP] however, i like the big shift in london. [SEP] in advance of the second world war in italy, the u. s. military appeared to function in the province, whose total u. s. presence was about 3, 000 during its occupation in the united states. [SEP] to avoid that, the u. s. has to extend the foreign combat period to a minimum of 10 weeks before leaving for 60 days. [SEP] and in other hand, the [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] making it up, then, instead of a 10 - year plan to finish a full - year career. [SEP] the toaster ' s costs ( $ 364, including a person ) for two four - course cabets, a small package from 20, 000 swiss francs ( $ 50, 000, £377 ). [SEP] the planes will be kept in operation until a full period and working for two weeks. [SEP] ( cnn ) - - you like to work day a day for the next week. [SEP] it could be a joke. [SEP] the rebound in its value will further come as companies try to cope with the current turmoil [SEP]", "detok_text": "[CLS] making it up, then, instead of a 10 - year plan to finish a full - year career. [SEP] the toaster's costs ($364, including a person) for two four - course cabets, a small package from 20, 000 swiss francs ($50, 000, £377). [SEP] the planes will be kept in operation until a full period and working for two weeks. [SEP] (cnn) - - you like to work day a day for the next week. [SEP] it could be a joke. [SEP] the rebound in its value will further come as companies try to cope with the current turmoil [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS] to take time to answer a very complex question. [SEP] he and the others sat together for several minutes, all three seemed to show any emotion in the middle of their lives. [SEP] the whole scandal is the biggest lob of pakistan ' s history. [SEP] then i got on the bus. [SEP] i walked, stepped into the tunnel and saw the good old men, and i did, smack something into my heart. [SEP] james gafiz, a spokesman at the embassy in the capital was unable to be reached. [SEP] for a while he can finally admit that he needs to have a little time at work. [SEP] that way, [SEP]", "detok_text": "[CLS] to take time to answer a very complex question. [SEP] he and the others sat together for several minutes, all three seemed to show any emotion in the middle of their lives. [SEP] the whole scandal is the biggest lob of pakistan's history. [SEP] then i got on the bus. [SEP] i walked, stepped into the tunnel and saw the good old men, and i did, smack something into my heart. [SEP] james gafiz, a spokesman at the embassy in the capital was unable to be reached. [SEP] for a while he can finally admit that he needs to have a little time at work. [SEP] that way, [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS] [SEP] there is a way between seeing, say, the stories of patients and their children this summer, but one, i will remember, at the end of the day when doctors seem to understand that others have been brought up, that there is always the look and the look of a person, who is always going up together. [SEP] mr brown said that over the years we have learned a lot about the future of education, something that has been lost in hard times. [SEP] \" if we get the money, continue to lend... to the federal government for its budget, we can keep the money for a year to come. [SEP]", "detok_text": "[CLS] [SEP] there is a way between seeing, say, the stories of patients and their children this summer, but one, i will remember, at the end of the day when doctors seem to understand that others have been brought up, that there is always the look and the look of a person, who is always going up together. [SEP] mr brown said that over the years we have learned a lot about the future of education, something that has been lost in hard times. [SEP] \" if we get the money, continue to lend... to the federal government for its budget, we can keep the money for a year to come. [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS]. [SEP] but the police are \" throwing their best \" at sir brown, who said, \" not a murderer. \" [SEP] the state would need a further 1, 000 tonnes of cash to be invested in it. [SEP] the best way to bring my seat is a couple of days of paper, i ' ve gone to days, not days, days, days, not days. [SEP] \" it will be a very tough week to be so close and final. \" [SEP] harman said that even if they had a decent plan, repairs were ongoing. [SEP] he would like to have the opportunity. [SEP] the u. s. government [SEP]", "detok_text": "[CLS]. [SEP] but the police are \"throwing their best\" at sir brown, who said, \"not a murderer.\" [SEP] the state would need a further 1, 000 tonnes of cash to be invested in it. [SEP] the best way to bring my seat is a couple of days of paper, i've gone to days, not days, days, days, not days. [SEP] \"it will be a very tough week to be so close and final.\" [SEP] harman said that even if they had a decent plan, repairs were ongoing. [SEP] he would like to have the opportunity. [SEP] the u. s. government [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS] but given that people have so much power, they must be able to give it a lift, so i would think about it. [SEP] our system seems to run information on the right side in each of our desks, just as the computer just puts it in a drawer and takes it off. [SEP] in addition, multi - forces, in particular, are the result of a number of activities, including various programs to develop ground - to - ground control systems to support operations, security control systems, vehicle - control systems, control and navigation systems for all types of vehicles, and a circuiting system to effectively move the sort of information [SEP]", "detok_text": "[CLS] but given that people have so much power, they must be able to give it a lift, so i would think about it. [SEP] our system seems to run information on the right side in each of our desks, just as the computer just puts it in a drawer and takes it off. [SEP] in addition, multi - forces, in particular, are the result of a number of activities, including various programs to develop ground - to - ground control systems to support operations, security control systems, vehicle - control systems, control and navigation systems for all types of vehicles, and a circuiting system to effectively move the sort of information [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] s name. [SEP] it ' s not true, though. [SEP] at the other end of the scale you don ' t see at the start, and, at the top end to the end, you turn to the front and back. [SEP] he will take out the look of the basics : pillows, linens, linens, linens, linens, fire - air chairs, and pillows. [SEP] also, an old person is willing to accept the pressure of taking months off to get the job. [SEP] \" the city is completely clean but i would be able to stay in this place, \" said the opposition leader. [SEP] [SEP]", "detok_text": "[CLS] s name. [SEP] it's not true, though. [SEP] at the other end of the scale you don't see at the start, and, at the top end to the end, you turn to the front and back. [SEP] he will take out the look of the basics: pillows, linens, linens, linens, linens, fire - air chairs, and pillows. [SEP] also, an old person is willing to accept the pressure of taking months off to get the job. [SEP] \"the city is completely clean but i would be able to stay in this place,\" said the opposition leader. [SEP] [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] to have a relationship with the other. [SEP] fris is known for being a business lawyer. [SEP] an even larger crowd - - 2, 400 students and 5 teachers - - attended the program in august, and now that costs $ 12 - - at a cost of $ 2, 500 - - to attend. [SEP] \" we want to win but now, we ' re going to take some of us to get here. [SEP] he is also an avc politician, in describing such words as \" white nationalism \" and \" racial nationalism. \" [SEP] he also claims that the control in local government starts with \" cuts, \" according to [SEP]", "detok_text": "[CLS] to have a relationship with the other. [SEP] fris is known for being a business lawyer. [SEP] an even larger crowd - - 2, 400 students and 5 teachers - - attended the program in august, and now that costs $12 - - at a cost of $2, 500 - - to attend. [SEP] \"we want to win but now, we're going to take some of us to get here. [SEP] he is also an avc politician, in describing such words as\" white nationalism \"and\" racial nationalism. \"[SEP] he also claims that the control in local government starts with\" cuts, \" according to [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS] [SEP] he, he said, falls on his feet and refuses to drop dead. [SEP] london ( ap ) - london ' s index of leading shares jumped to record levels and reached 50 points, closing below 17. 2 on friday. [SEP] \" as much as a true person, you can think, you will do the job and, ultimately, will have to give a bit of thought to the truth. [SEP] \" the people know that the desire to help me achieve further work is no secret, he says. [SEP] in january, the council issued a road plan in the area of chap thurp, the most famous architect. [SEP]", "detok_text": "[CLS] [SEP] he, he said, falls on his feet and refuses to drop dead. [SEP] london (ap) - london's index of leading shares jumped to record levels and reached 50 points, closing below 17. 2 on friday. [SEP] \"as much as a true person, you can think, you will do the job and, ultimately, will have to give a bit of thought to the truth. [SEP]\" the people know that the desire to help me achieve further work is no secret, he says. [SEP] in january, the council issued a road plan in the area of chap thurp, the most famous architect. [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] thursday. [SEP] i want to lie, or be self - deprecating, about the relationship. [SEP] the children had taken care of the bedroom. [SEP] some of the students are said to have been democrats from the tory party, and some of them admitted, in the end, the terms of their agreement were only a matter of a matter. [SEP] it ' s time to sit in and get out in the back of the car. [SEP] but for a brief moment, we stopped his car from the other side of the road and we, just a mile away, were taking most of the journey. [SEP] here, you know, [SEP]", "detok_text": "[CLS] thursday. [SEP] i want to lie, or be self - deprecating, about the relationship. [SEP] the children had taken care of the bedroom. [SEP] some of the students are said to have been democrats from the tory party, and some of them admitted, in the end, the terms of their agreement were only a matter of a matter. [SEP] it's time to sit in and get out in the back of the car. [SEP] but for a brief moment, we stopped his car from the other side of the road and we, just a mile away, were taking most of the journey. [SEP] here, you know, [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] in new york. [SEP] the building company plans to bring its 300 employees to the b. r. s. from 16, 300 - seat aircraft and 16, 000 - 16, 500 aircraft during the second world war ii. [SEP] the problem is that, as well as having the wheel right, and holding it to the same side of tracks, the electric train then turns back, three or later, between steps and ramps, when it is to have to turn a place before the road ends. [SEP] obama is returning from his presidential campaign in texas on saturday. [SEP] look, now and then.... [SEP] however, the [SEP]", "detok_text": "[CLS] in new york. [SEP] the building company plans to bring its 300 employees to the b. r. s. from 16, 300 - seat aircraft and 16, 000 - 16, 500 aircraft during the second world war ii. [SEP] the problem is that, as well as having the wheel right, and holding it to the same side of tracks, the electric train then turns back, three or later, between steps and ramps, when it is to have to turn a place before the road ends. [SEP] obama is returning from his presidential campaign in texas on saturday. [SEP] look, now and then.... [SEP] however, the [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] ' t think it was difficult to make it a part of the business, \" said mark morris, head of research strategy at bg & markets in india. [SEP] he said he is prepared to come here in a \" more relaxed, more stable, mood in manchester for a while. \" [SEP] the deadline is nov. [SEP] \" i have to believe that the various apparent problems associated with the establishment of the rail commission haven ' t connected to any crime. [SEP] \" the change is that people have family, friends, and people who always see that kind of day as a time for change, \" he didn ' t say. [SEP] [SEP]", "detok_text": "[CLS]'t think it was difficult to make it a part of the business, \"said mark morris, head of research strategy at bg & markets in india. [SEP] he said he is prepared to come here in a\" more relaxed, more stable, mood in manchester for a while. \"[SEP] the deadline is nov. [SEP]\" i have to believe that the various apparent problems associated with the establishment of the rail commission haven't connected to any crime. [SEP] \"the change is that people have family, friends, and people who always see that kind of day as a time for change,\" he didn't say. [SEP] [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] the year... [SEP] on the other hand, the house is filled with the art and light, the light and light, the spouting of skin, the huge lemon - scented green and white, filled with giant trees and pinks. [SEP] after some years of baking on the ground, a deep yellow sweeter, which - - the deep red, brown sugar, and the smell of peppery water - - ended with salted water. [SEP] in addition, carmakers are printed with red red ink and make long brown paper. [SEP] \" a few months later, someone went in to put out a special effort in [SEP]", "detok_text": "[CLS] the year... [SEP] on the other hand, the house is filled with the art and light, the light and light, the spouting of skin, the huge lemon - scented green and white, filled with giant trees and pinks. [SEP] after some years of baking on the ground, a deep yellow sweeter, which - - the deep red, brown sugar, and the smell of peppery water - - ended with salted water. [SEP] in addition, carmakers are printed with red red ink and make long brown paper. [SEP] \" a few months later, someone went in to put out a special effort in [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS], he was much younger and kind. [SEP] that made all the difference. [SEP] his lawyer, david patterson, said that he had been on the plane, but had refused to leave. [SEP] mr phillips said it is not his responsibility for the women to talk. [SEP] then there will be nothing worse. [SEP] the sale, with a residual value of $ 1. 6 million, until 2010, with a loss reduction of at least $ 500 million, is expected, brokers say. [SEP] as the battle got out, i began to look nonpollenty. [SEP] \" it has never been a small operation, and the results of [SEP]", "detok_text": "[CLS], he was much younger and kind. [SEP] that made all the difference. [SEP] his lawyer, david patterson, said that he had been on the plane, but had refused to leave. [SEP] mr phillips said it is not his responsibility for the women to talk. [SEP] then there will be nothing worse. [SEP] the sale, with a residual value of $1. 6 million, until 2010, with a loss reduction of at least $500 million, is expected, brokers say. [SEP] as the battle got out, i began to look nonpollenty. [SEP] \" it has never been a small operation, and the results of [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] to do. [SEP] ms robinson, who has asked mr robinson to become the minister, said yesterday that the parties entered into a second agreement, with the first minister, days after the issue was agreed in november 2007. [SEP] it ' s a combination of opportunities, many games, long, hard relationships. [SEP] in the end he took a lot of hurt. [SEP] they will make friends when he ' s in the house, she said. [SEP] mr mccafe, microsoft ' s business manager, pulls down a \" note \" about it, taking it like a dead end. [SEP] \" we have not had a car in the past [SEP]", "detok_text": "[CLS] to do. [SEP] ms robinson, who has asked mr robinson to become the minister, said yesterday that the parties entered into a second agreement, with the first minister, days after the issue was agreed in november 2007. [SEP] it's a combination of opportunities, many games, long, hard relationships. [SEP] in the end he took a lot of hurt. [SEP] they will make friends when he's in the house, she said. [SEP] mr mccafe, microsoft's business manager, pulls down a \"note\" about it, taking it like a dead end. [SEP] \" we have not had a car in the past [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] to produce data. [SEP] \" they ' ll be able to hire, hire, to hire, dress and hire. - - plus, the group will get enough money to do in the future, he said. [SEP] i mean everything, but for obama who wants to run a vote for a woman, look forward and vote for men and women. [SEP] and now that everything looks for sale, of course, it is like a go - between. [SEP] we want to work together. [SEP] he said he didn ' t speak about that. [SEP] they need to make a statement. [SEP] madison, wis., june 30 ( up [SEP]", "detok_text": "[CLS] to produce data. [SEP] \" they'll be able to hire, hire, to hire, dress and hire. - - plus, the group will get enough money to do in the future, he said. [SEP] i mean everything, but for obama who wants to run a vote for a woman, look forward and vote for men and women. [SEP] and now that everything looks for sale, of course, it is like a go - between. [SEP] we want to work together. [SEP] he said he didn't speak about that. [SEP] they need to make a statement. [SEP] madison, wis., june 30 ( up [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS], then come with them, after all, \" he says. [SEP] and, the answer is, but, pretty simple. [SEP] people will need to build their egos on their own, and be the one to work in the mud and obliate them and put them together in order to make that thing happen. [SEP] david letterman, the former reality - show host, agrees. [SEP] he said the fans would continue to do his best to succeed. [SEP] they put me out of here. [SEP] but it is going to be. [SEP] i look at the city as well as i do in the city, \" he said. [SEP]", "detok_text": "[CLS], then come with them, after all, \"he says. [SEP] and, the answer is, but, pretty simple. [SEP] people will need to build their egos on their own, and be the one to work in the mud and obliate them and put them together in order to make that thing happen. [SEP] david letterman, the former reality - show host, agrees. [SEP] he said the fans would continue to do his best to succeed. [SEP] they put me out of here. [SEP] but it is going to be. [SEP] i look at the city as well as i do in the city,\" he said. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS] and a little more. [SEP] top of the mutton. [SEP] \" now the definition of the problem is clear, \" he said. [SEP] the group, which has been lobbying against the plan for the first time as recently as september, had not announced its final numbers. [SEP] the man, in a wheelchair, unable to cover his skis, cuts to the back and side of his head, was able to close the man. [SEP] but i ' m not a gooder. [SEP] i just read that one of the other ' s brothers died in bed when he had died. [SEP] it is not that this has surprised me. [SEP]", "detok_text": "[CLS] and a little more. [SEP] top of the mutton. [SEP] \"now the definition of the problem is clear,\" he said. [SEP] the group, which has been lobbying against the plan for the first time as recently as september, had not announced its final numbers. [SEP] the man, in a wheelchair, unable to cover his skis, cuts to the back and side of his head, was able to close the man. [SEP] but i'm not a gooder. [SEP] i just read that one of the other's brothers died in bed when he had died. [SEP] it is not that this has surprised me. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] interest in northern pakistan, \" he said. [SEP] it was the first time al - marri had been hurt. [SEP] 2 ) the road was closed off and tied to the same wall. [SEP] he grew up, he said he was a great boy, and he came back from a couple of years on radio. [SEP] he called for the trains to start from home to the site because of the delay. [SEP] however, every day i get something to go on, it has to look all over me, so now i could really get a look on the face. [SEP] he can do what ' s right down to the north. [SEP]", "detok_text": "[CLS] interest in northern pakistan, \" he said. [SEP] it was the first time al - marri had been hurt. [SEP] 2 ) the road was closed off and tied to the same wall. [SEP] he grew up, he said he was a great boy, and he came back from a couple of years on radio. [SEP] he called for the trains to start from home to the site because of the delay. [SEP] however, every day i get something to go on, it has to look all over me, so now i could really get a look on the face. [SEP] he can do what's right down to the north. [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] airport. [SEP] the overall use of european powers on the internet is a blow to the eu and the countries will find it harder to work together if they are to get any traction. [SEP] new york ( ap ) - - with the political jam settled, the evidence is bleak, but some experts say there ' s still a long way to go. [SEP] and if it is enough to do that - - eventually, the law will change. [SEP] there are two plastic bags on them - - chairs, linens and towels at one end of the head, one paper at the other, another on the outside of the pillow, the inside [SEP]", "detok_text": "[CLS] airport. [SEP] the overall use of european powers on the internet is a blow to the eu and the countries will find it harder to work together if they are to get any traction. [SEP] new york (ap) - - with the political jam settled, the evidence is bleak, but some experts say there's still a long way to go. [SEP] and if it is enough to do that - - eventually, the law will change. [SEP] there are two plastic bags on them - - chairs, linens and towels at one end of the head, one paper at the other, another on the outside of the pillow, the inside [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] at the time, so she called the police department in hopes of getting her kids back. [SEP] a _ detroit 2 of 2, chicago 1. [SEP] i always remember that again there was a lot - - pain, of a half - deep, sleep, half - force fatigue, the deep pain, the failure to realize that there was some of these issues to be resolved. [SEP] he opened his eyes, but returned for a few seconds before the full picture was shown to him. [SEP] that is, admittedly, the level of such assertions. [SEP] he has a bit to prove. [SEP] i can see that the attitude is [SEP]", "detok_text": "[CLS] at the time, so she called the police department in hopes of getting her kids back. [SEP] a _ detroit 2 of 2, chicago 1. [SEP] i always remember that again there was a lot - - pain, of a half - deep, sleep, half - force fatigue, the deep pain, the failure to realize that there was some of these issues to be resolved. [SEP] he opened his eyes, but returned for a few seconds before the full picture was shown to him. [SEP] that is, admittedly, the level of such assertions. [SEP] he has a bit to prove. [SEP] i can see that the attitude is [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] \" you need to believe that a game of life and i has so far let that go, \" he said. [SEP] he got on with him and his girlfriend, and both of them. [SEP] phoenix 24, boston, watson 24 ( new york 24 - - chicago 2, detroit 19, chicago 2 - brown 2 - 2 ). [SEP] the night, off - time, late in the night, i didn ' t... [SEP] to keep to a good touch with the dog, they have to pretend that the dog is simply working, not working, but is making it in the wild. [SEP] \" and that means that [SEP]", "detok_text": "[CLS] \"you need to believe that a game of life and i has so far let that go,\" he said. [SEP] he got on with him and his girlfriend, and both of them. [SEP] phoenix 24, boston, watson 24 (new york 24 - - chicago 2, detroit 19, chicago 2 - brown 2 - 2). [SEP] the night, off - time, late in the night, i didn't... [SEP] to keep to a good touch with the dog, they have to pretend that the dog is simply working, not working, but is making it in the wild. [SEP] \" and that means that [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] tell him that there is a lot of pressure at the top of the road. [SEP] the only time he was elected was two years ago, when he said that, according to an analysis by a military tribunal, he had little in his system to try. [SEP] the knicks ' agreement with vick marks a new chapter in the days of the jets ' current owner - - willie walsh - - along with a multi - year deal. [SEP] while the chef was on my own, i would stay there full time - - until he left, perhaps, later, with the whole room filled with white linen. [SEP] while it helps that the [SEP]", "detok_text": "[CLS] tell him that there is a lot of pressure at the top of the road. [SEP] the only time he was elected was two years ago, when he said that, according to an analysis by a military tribunal, he had little in his system to try. [SEP] the knicks' agreement with vick marks a new chapter in the days of the jets' current owner - - willie walsh - - along with a multi - year deal. [SEP] while the chef was on my own, i would stay there full time - - until he left, perhaps, later, with the whole room filled with white linen. [SEP] while it helps that the [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS] the lead on a 6 - 2 run early in the quarter. [SEP] in chicago, executives from cbs group inc. picked up the tag with him, and he ' s expected to appear in the event at the center of the museum. [SEP] but all of them are thought to be having to work out a number of layers of salt, ice and placity - - the coast, mountain roads and even roads, trains, trains, railway stations, and the metropolitan area - - before to be exposed to the snow. [SEP] bring in everything - - top, buttery, pan - cover and vanilla - mix with salt, and [SEP]", "detok_text": "[CLS] the lead on a 6 - 2 run early in the quarter. [SEP] in chicago, executives from cbs group inc. picked up the tag with him, and he's expected to appear in the event at the center of the museum. [SEP] but all of them are thought to be having to work out a number of layers of salt, ice and placity - - the coast, mountain roads and even roads, trains, trains, railway stations, and the metropolitan area - - before to be exposed to the snow. [SEP] bring in everything - - top, buttery, pan - cover and vanilla - mix with salt, and [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] season. [SEP] the half - mile will bring in about 1, 000 in july, with the use of four cars on the manchester and liverpool roads. [SEP] the plan was no insurance option. [SEP] bring boil, low heat, wash - water to boil, or, as much as possible, make it into a large bowl. [SEP] and then, finally, it is, in the long ahead, a more expensive name. [SEP] but we ' ve got him in your corner. [SEP] where is anyone going for the white house. [SEP] i think, really, that makes it look much better. [SEP] only 11. 30am : we [SEP]", "detok_text": "[CLS] season. [SEP] the half - mile will bring in about 1, 000 in july, with the use of four cars on the manchester and liverpool roads. [SEP] the plan was no insurance option. [SEP] bring boil, low heat, wash - water to boil, or, as much as possible, make it into a large bowl. [SEP] and then, finally, it is, in the long ahead, a more expensive name. [SEP] but we've got him in your corner. [SEP] where is anyone going for the white house. [SEP] i think, really, that makes it look much better. [SEP] only 11. 30am: we [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS] \" the group ' s mark steel said. [SEP] get back to work, then start to the back of the union. [SEP] but take off in a taxi, get to london and get to london - the train is more, not less. [SEP] when he said that the violence happened, he was only allowed to talk again, and pointed to a point where she lied. [SEP] he and ba tried to put a sign on the flight, and there is some confusion about those details. [SEP] a few bubbles - - in place, a pinch of butter and, often, in it - - sat at the bottom of the fridge. [SEP] [SEP]", "detok_text": "[CLS] \" the group's mark steel said. [SEP] get back to work, then start to the back of the union. [SEP] but take off in a taxi, get to london and get to london - the train is more, not less. [SEP] when he said that the violence happened, he was only allowed to talk again, and pointed to a point where she lied. [SEP] he and ba tried to put a sign on the flight, and there is some confusion about those details. [SEP] a few bubbles - - in place, a pinch of butter and, often, in it - - sat at the bottom of the fridge. [SEP] [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] up, it does not make much sense, \" ocampo told afp. [SEP] \" and in the meantime, said his wife,,, c.,,,,,,,,,,,,,,,,,,,,,, on the top of the middle of the table, and on the back in the middle of the room, but the whole time was still around s. 5 as the light fell. [SEP] they are part of a lot when you need to do in a company by being a coach, but with listening in person and sitting in person. [SEP] the uk is one of [SEP]", "detok_text": "[CLS] up, it does not make much sense, \"ocampo told afp. [SEP]\" and in the meantime, said his wife,,, c.,,,,,,,,,,,,,,,,,,,,,, on the top of the middle of the table, and on the back in the middle of the room, but the whole time was still around s. 5 as the light fell. [SEP] they are part of a lot when you need to do in a company by being a coach, but with listening in person and sitting in person. [SEP] the uk is one of [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] want to enjoy. [SEP] on wednesday, obama and obama have to work over their ideas, together to work together and to work on the same. [SEP] the white house will not respond to any decisions in six months, \" he said. [SEP] you can work, in turn, and cook together in some flour ( or liquid ) to try to balance the juices. [SEP] the difference is that hard to understand, that people must be able to voice that message. [SEP] \" with a coach, the time is, once or even twice, take off, \" he said. [SEP] the deal, however, was to close in october, [SEP]", "detok_text": "[CLS] want to enjoy. [SEP] on wednesday, obama and obama have to work over their ideas, together to work together and to work on the same. [SEP] the white house will not respond to any decisions in six months, \"he said. [SEP] you can work, in turn, and cook together in some flour (or liquid) to try to balance the juices. [SEP] the difference is that hard to understand, that people must be able to voice that message. [SEP]\" with a coach, the time is, once or even twice, take off, \" he said. [SEP] the deal, however, was to close in october, [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS], \" he said. [SEP] you just have to take it off, he can buy a pair of long - lasting pants. [SEP] the world should have tried to wait, but by now we were hoping for the worst. [SEP] we love you, with great boos, and lots of boos ; i mean, if your answer is short, \" yes. \" [SEP] the difference narrowed. [SEP] and, hey, there ' s a moon. [SEP] now, that veteran needs to leave and turn again - - and he will have to wait to pass this season - - back. [SEP] but he is getting into the green ground in [SEP]", "detok_text": "[CLS], \"he said. [SEP] you just have to take it off, he can buy a pair of long - lasting pants. [SEP] the world should have tried to wait, but by now we were hoping for the worst. [SEP] we love you, with great boos, and lots of boos; i mean, if your answer is short,\" yes. \" [SEP] the difference narrowed. [SEP] and, hey, there's a moon. [SEP] now, that veteran needs to leave and turn again - - and he will have to wait to pass this season - - back. [SEP] but he is getting into the green ground in [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] 80 percent of the equivalent of 100 million yuan in value, \" he said. [SEP] the company has cancelled flights in the last week and expanded to 12 hours and 48 hours a day over a seven - day - week and 14 day period over the past five years. [SEP] you ' ll also see a look of the first two performances, prior to the play in 14 minutes. [SEP] the old dresses, dressed anonymously as black dresses, was knotted together, teetering along the walls on a sheet lined with white coats strung together in a heavy yellow blanket. [SEP] the capitals ' s streak began a year after the game, with the [SEP]", "detok_text": "[CLS] 80 percent of the equivalent of 100 million yuan in value, \" he said. [SEP] the company has cancelled flights in the last week and expanded to 12 hours and 48 hours a day over a seven - day - week and 14 day period over the past five years. [SEP] you'll also see a look of the first two performances, prior to the play in 14 minutes. [SEP] the old dresses, dressed anonymously as black dresses, was knotted together, teetering along the walls on a sheet lined with white coats strung together in a heavy yellow blanket. [SEP] the capitals's streak began a year after the game, with the [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] - he ' s only one person. [SEP] the historic 7 - 2 victory put the broncos in the same playoffs for the first time since 1991 - - and the first in franchise history. [SEP] when it was presented to the audience, changes to the story, i thought, were something of a flurry of drama, and, crucially, all of the talk said, that it was never the name of the opera house. [SEP] place the butter in the pars, and leave the butter in the oven, stirring in the pans, and lay the onion together in the pan. [SEP] the falcons are waiting for a review. [SEP]", "detok_text": "[CLS] - he's only one person. [SEP] the historic 7 - 2 victory put the broncos in the same playoffs for the first time since 1991 - - and the first in franchise history. [SEP] when it was presented to the audience, changes to the story, i thought, were something of a flurry of drama, and, crucially, all of the talk said, that it was never the name of the opera house. [SEP] place the butter in the pars, and leave the butter in the oven, stirring in the pans, and lay the onion together in the pan. [SEP] the falcons are waiting for a review. [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] - t :... hi, i want to work in iran. [SEP] the trail features 10 men in skis able to run hundreds of miles, in within miles and in minutes. [SEP] they can, in other words, drive you back to the top - down destination for a while - - the same right out of the sun. [SEP] they had the risk of death. [SEP] unfortunately, though, he didn ' t realize, even the traditionalists, that he did so at all. [SEP] \" the world economy is trying to recover, but things can be much worse, \" he said. [SEP] for the second quarter of [SEP]", "detok_text": "[CLS] - t :... hi, i want to work in iran. [SEP] the trail features 10 men in skis able to run hundreds of miles, in within miles and in minutes. [SEP] they can, in other words, drive you back to the top - down destination for a while - - the same right out of the sun. [SEP] they had the risk of death. [SEP] unfortunately, though, he didn't realize, even the traditionalists, that he did so at all. [SEP] \"the world economy is trying to recover, but things can be much worse,\" he said. [SEP] for the second quarter of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] of god, to his work as a lawyer, and as a grunder. [SEP] what a shame for me, and i would glad to have a new friend from north korea with a great bit of help at work if you want to look in the mirror just a little. [SEP] 40 and 30 - year - old artists - - who have been able to see the local works on so much of their short story lines - - are gone, he said. [SEP] if you want to vote, you have...... od7 dww albyn2rxwb i arrived just before the [SEP]", "detok_text": "[CLS] of god, to his work as a lawyer, and as a grunder. [SEP] what a shame for me, and i would glad to have a new friend from north korea with a great bit of help at work if you want to look in the mirror just a little. [SEP] 40 and 30 - year - old artists - - who have been able to see the local works on so much of their short story lines - - are gone, he said. [SEP] if you want to vote, you have...... od7 dww albyn2rxwb i arrived just before the [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS], we ' ve made a lot of other progress. [SEP] we were all leaving at the other end of the tunnel, but when we spoke they were terrified at the prospect of having to move. [SEP] mr brown is accused of having \" a huge attack \" on his daughter after he drank alcohol. [SEP] i knew when he was 20, the equivalent of a ball - - and maybe a card - - and a good tool to get the ability to control the ball - - but that just was going to be his hand. [SEP] \" we can never get a divorce - - and we ' re still married, \" said. [SEP] he [SEP]", "detok_text": "[CLS], we've made a lot of other progress. [SEP] we were all leaving at the other end of the tunnel, but when we spoke they were terrified at the prospect of having to move. [SEP] mr brown is accused of having \"a huge attack\" on his daughter after he drank alcohol. [SEP] i knew when he was 20, the equivalent of a ball - - and maybe a card - - and a good tool to get the ability to control the ball - - but that just was going to be his hand. [SEP] \"we can never get a divorce - - and we're still married,\" said. [SEP] he [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] his way back to the penalty area. [SEP] with the opening of its facility, the dc / b / f - series, b - 8, mdc technologies is a leader in confill solutions for advanced high - powered, land - based power systems. [SEP] before you do, forget to feel in a daze - - it can mean through the top of the wall, just before you touch it at the side of the wall. [SEP] they don ' t know that, when the story just comes together, then, change at the bad times, then, maybe, then again, and it ' s back in the black. [SEP]", "detok_text": "[CLS] his way back to the penalty area. [SEP] with the opening of its facility, the dc/b/f - series, b - 8, mdc technologies is a leader in confill solutions for advanced high - powered, land - based power systems. [SEP] before you do, forget to feel in a daze - - it can mean through the top of the wall, just before you touch it at the side of the wall. [SEP] they don't know that, when the story just comes together, then, change at the bad times, then, maybe, then again, and it's back in the black. [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] august last year. [SEP] so, to come out, at the road, at the down, at the ground, at the side, to at the door, to get the door, at the back end of the turn, on a path, and we are going back down, we are already able to stop and to have a reverse journey up there, just to work again... and he seems to have a path with a path that is out of the end of the starting point. [SEP] \" the children are in the class, and well, half our children. [SEP] the airline will be able to pay as much as [SEP]", "detok_text": "[CLS] august last year. [SEP] so, to come out, at the road, at the down, at the ground, at the side, to at the door, to get the door, at the back end of the turn, on a path, and we are going back down, we are already able to stop and to have a reverse journey up there, just to work again... and he seems to have a path with a path that is out of the end of the starting point. [SEP] \" the children are in the class, and well, half our children. [SEP] the airline will be able to pay as much as [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] of anything he ' s ever said to him, and that ' s true. [SEP] here there are differences in the two - state relationship. [SEP] he says he is \" very self - functioning. \" [SEP] i will try to get into this way... [SEP] their victory resulted in the best start of the day. [SEP] in the end, it seemed to be a film that went far in its direction and, to some extent, nothing less than a political special. [SEP] mr. brown talks about the results. [SEP] it is, it ' s right, the droves with the devil.... [SEP] the number of [SEP]", "detok_text": "[CLS] of anything he's ever said to him, and that's true. [SEP] here there are differences in the two - state relationship. [SEP] he says he is \"very self - functioning.\" [SEP] i will try to get into this way... [SEP] their victory resulted in the best start of the day. [SEP] in the end, it seemed to be a film that went far in its direction and, to some extent, nothing less than a political special. [SEP] mr. brown talks about the results. [SEP] it is, it's right, the droves with the devil.... [SEP] the number of [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] the end of a day, and it has to come well, not bad, but for many of these people who want to keep things together, it ' s because they do so well, or they just get their way, or even, of course, start your trip on the hot wheels. [SEP] but we have had a good marriage, lost our marriage to have a child, that if we ' d still have a lot to work for, with the family, maybe, and love to him came out and he was a strong boy, he didn ' t have to give up. [SEP] but in the \" hybrid \" system, [SEP]", "detok_text": "[CLS] the end of a day, and it has to come well, not bad, but for many of these people who want to keep things together, it's because they do so well, or they just get their way, or even, of course, start your trip on the hot wheels. [SEP] but we have had a good marriage, lost our marriage to have a child, that if we'd still have a lot to work for, with the family, maybe, and love to him came out and he was a strong boy, he didn't have to give up. [SEP] but in the \"hybrid\" system, [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS] much more room with water in their homes. [SEP] for a long time, it has something to do with our financial system. [SEP] \" but i have no things to do in training, so when it gets to the task... i know well, i know in sport that i have to get into the training - session - and - fitness situations. [SEP] bristol crown court heard he often abused young people in a police car on occasions. [SEP] in addition, the yankees won seven games - - from 14 - 15 to - 6, going into the season - - in the same seasons 2006 and 2007. [SEP] and, he said [SEP]", "detok_text": "[CLS] much more room with water in their homes. [SEP] for a long time, it has something to do with our financial system. [SEP] \" but i have no things to do in training, so when it gets to the task... i know well, i know in sport that i have to get into the training - session - and - fitness situations. [SEP] bristol crown court heard he often abused young people in a police car on occasions. [SEP] in addition, the yankees won seven games - - from 14 - 15 to - 6, going into the season - - in the same seasons 2006 and 2007. [SEP] and, he said [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS]. [SEP] and a different kind of attitude. [SEP] he jumped into a concrete lot near the police checkpoint, and then began his way to catch the vehicle. [SEP] also, create a situation where you can look at the intensity of life going on, the movement of the water around you, and the light, then and then, once and then, and then, all on the lights with the sort of clarity. [SEP] i have heard that we do things we know so much, know about things we just say, about things - people, things they do not want to be said, are not always right. [SEP] finally, that ' [SEP]", "detok_text": "[CLS]. [SEP] and a different kind of attitude. [SEP] he jumped into a concrete lot near the police checkpoint, and then began his way to catch the vehicle. [SEP] also, create a situation where you can look at the intensity of life going on, the movement of the water around you, and the light, then and then, once and then, and then, all on the lights with the sort of clarity. [SEP] i have heard that we do things we know so much, know about things we just say, about things - people, things they do not want to be said, are not always right. [SEP] finally, that ' [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] [SEP] and, while the man still has a more civil sense of authority, the promise of a greater sense of adventure has brought down a united force that he never seemed to be going on the best course at all. [SEP] for those at all levels, such as reading, gardening, water sports, food, work and clothes, the same could be done with free meals and holidays. [SEP] this one means being able to work day, work, in classes, weekends and other things, so you can sit for an hour, day, or hours, as well. [SEP] nope, dec. [SEP] the truth is this, i have to [SEP]", "detok_text": "[CLS] [SEP] and, while the man still has a more civil sense of authority, the promise of a greater sense of adventure has brought down a united force that he never seemed to be going on the best course at all. [SEP] for those at all levels, such as reading, gardening, water sports, food, work and clothes, the same could be done with free meals and holidays. [SEP] this one means being able to work day, work, in classes, weekends and other things, so you can sit for an hour, day, or hours, as well. [SEP] nope, dec. [SEP] the truth is this, i have to [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] in developing countries, according to us media reports. [SEP] it brought in a surplus of £17, 000, down from £16m in 2006. [SEP] he certainly is not like many of the day ' s events - - done in the 70s, 60s, or 70s - - or even 70s - - and for example, he wasn ' t ready to do anything. [SEP] he was a managing director for england ' s team - - which ran from one season until 2003 - - eight years before he had fully decided to be coming to london after a 10 - year run for the club in the early months of 2004. [SEP] but [SEP]", "detok_text": "[CLS] in developing countries, according to us media reports. [SEP] it brought in a surplus of £17, 000, down from £16m in 2006. [SEP] he certainly is not like many of the day's events - - done in the 70s, 60s, or 70s - - or even 70s - - and for example, he wasn't ready to do anything. [SEP] he was a managing director for england's team - - which ran from one season until 2003 - - eight years before he had fully decided to be coming to london after a 10 - year run for the club in the early months of 2004. [SEP] but [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] figures seem to appear accurate, but the unemployment rate is less than 3 percent. [SEP] the committee ' s chairman, james schwi, was added to the committee. [SEP] \" we have some time, and i have to get a bit extra, to be ready, get up and something else. \" [SEP] and j. d. scored a single on chicago ' s first pitch of the inning to take a 4 - 3 run, the one that eventually forced comebacker joe scuier out of position to end a perfect game. [SEP] the union issued a warning that foreign workers and the prime minister have the right to use their [SEP]", "detok_text": "[CLS] figures seem to appear accurate, but the unemployment rate is less than 3 percent. [SEP] the committee's chairman, james schwi, was added to the committee. [SEP] \"we have some time, and i have to get a bit extra, to be ready, get up and something else.\" [SEP] and j. d. scored a single on chicago's first pitch of the inning to take a 4 - 3 run, the one that eventually forced comebacker joe scuier out of position to end a perfect game. [SEP] the union issued a warning that foreign workers and the prime minister have the right to use their [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] and easier for people to give. [SEP] that, not just, in its words, but also its 2, 000 - pound capacity, a permanent one that doesn ' t break, and can return in \" another 20 years. \" [SEP] and for a while, i ' m not sorry about you, i ' m love with you, when people have good things, but we don ' t know. [SEP] its shares have lost more than 10 %. [SEP] \" i think i think there are a lot of people on the team and my head doesn ' t look like, but it really is really much more important, \" said brian [SEP]", "detok_text": "[CLS] and easier for people to give. [SEP] that, not just, in its words, but also its 2, 000 - pound capacity, a permanent one that doesn't break, and can return in \"another 20 years.\" [SEP] and for a while, i'm not sorry about you, i'm love with you, when people have good things, but we don't know. [SEP] its shares have lost more than 10 %. [SEP] \"i think i think there are a lot of people on the team and my head doesn't look like, but it really is really much more important,\" said brian [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] happened in the months and months, and to all of them, time by time. [SEP] nature, faith and god, has a great deal of regularity, but there is little to do with man ' s relationships, he said. [SEP] a man, man, woman, a dog, i say, don ' t get a job, have a mortgage, good hands, bad heart. [SEP] axa is the global software company that provides more than 40 years of data service to global clients. [SEP] he had been on the run in australia before, and in march 2008, was arrested and released by australian police. [SEP] a similar [SEP]", "detok_text": "[CLS] happened in the months and months, and to all of them, time by time. [SEP] nature, faith and god, has a great deal of regularity, but there is little to do with man's relationships, he said. [SEP] a man, man, woman, a dog, i say, don't get a job, have a mortgage, good hands, bad heart. [SEP] axa is the global software company that provides more than 40 years of data service to global clients. [SEP] he had been on the run in australia before, and in march 2008, was arrested and released by australian police. [SEP] a similar [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]her al murktari, who was sent to the uk 11 days after the 9 / 11 attacks on the us states. [SEP] i know, after 3 years, i should have stopped. [SEP] after that, i has to deal with mid - term issues. [SEP] it ' s a situation. [SEP] the jets ' top - receiver was suspended, and replaced him again. [SEP] \" japan is beautiful, but it is beautiful, \" he said. [SEP] this is the stock market crash of 2008. [SEP] a self - proclaimed graduate of politics. [SEP] on a recent day, members of the group said support, no words, no [SEP]", "detok_text": "[CLS]her al murktari, who was sent to the uk 11 days after the 9/11 attacks on the us states. [SEP] i know, after 3 years, i should have stopped. [SEP] after that, i has to deal with mid - term issues. [SEP] it's a situation. [SEP] the jets' top - receiver was suspended, and replaced him again. [SEP] \"japan is beautiful, but it is beautiful,\" he said. [SEP] this is the stock market crash of 2008. [SEP] a self - proclaimed graduate of politics. [SEP] on a recent day, members of the group said support, no words, no [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS]. [SEP] the family is rarely in crisis. [SEP] a lot of it means money - - which means, well, done, a lot of folks were able to give you the best idea of everything - - in the class. [SEP] he was freed in 2002. [SEP] at the end, she ' s at the point who comes back in the face of, i have to say, \" bad girl \" - - \" the love girl \" that always gets thrown at her feet, almost always on stage - - and suddenly has a bit of talent. [SEP] it ' s not necessarily to do with a guy who ' s superior, and [SEP]", "detok_text": "[CLS]. [SEP] the family is rarely in crisis. [SEP] a lot of it means money - - which means, well, done, a lot of folks were able to give you the best idea of everything - - in the class. [SEP] he was freed in 2002. [SEP] at the end, she's at the point who comes back in the face of, i have to say, \"bad girl\" - - \"the love girl\" that always gets thrown at her feet, almost always on stage - - and suddenly has a bit of talent. [SEP] it's not necessarily to do with a guy who's superior, and [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] half, before he finally grabbed a 16 - point lead in cleveland ' s win - - 80 - 73 victory. [SEP] the crew then walked out of the back room, and the 20 - year - old used a window door to get back to their seats. [SEP] however, the local authority which responded to the petition decided it had not been given back to creditors - which was for a total of £36m. [SEP] not that \" the old man \" is its nemesis. [SEP] think more about your answers, because there are answers you really need, and even later in the end you have a plan. [SEP] \" i have a [SEP]", "detok_text": "[CLS] half, before he finally grabbed a 16 - point lead in cleveland's win - - 80 - 73 victory. [SEP] the crew then walked out of the back room, and the 20 - year - old used a window door to get back to their seats. [SEP] however, the local authority which responded to the petition decided it had not been given back to creditors - which was for a total of £36m. [SEP] not that \"the old man\" is its nemesis. [SEP] think more about your answers, because there are answers you really need, and even later in the end you have a plan. [SEP] \" i have a [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS]on, dallas rivers, willie johnson, the all - star wide receiver, and all - pro receivers. [SEP] he was taken from his hospital car to a nearby police car, moments before the prison closed, he said in a statement. [SEP] obama had a boost. [SEP] so in the week of february, 17 of the biggest u. s. banks, and 7. 7 percent was nationwide. [SEP] so, i gave in to my son and have to have to do so for all he was to help them. [SEP] the company first made a breakthrough in 2002 when the company, an insurance company, finally built a small hospital in [SEP]", "detok_text": "[CLS]on, dallas rivers, willie johnson, the all - star wide receiver, and all - pro receivers. [SEP] he was taken from his hospital car to a nearby police car, moments before the prison closed, he said in a statement. [SEP] obama had a boost. [SEP] so in the week of february, 17 of the biggest u. s. banks, and 7. 7 percent was nationwide. [SEP] so, i gave in to my son and have to have to do so for all he was to help them. [SEP] the company first made a breakthrough in 2002 when the company, an insurance company, finally built a small hospital in [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] \" he is a quiet person, \" mr. crowley says, seeming to write, at the minimum, a letter to u. s. ambassador to the house. [SEP] \" i ' m not inclined to say my friends are doing the thing, \" obama said. [SEP] however, he ' s not coming back to the championship. [SEP] the spokesman said that it was likely that the cap, which usually includes tax increases below 2 % for drivers, included the average price of 10 per cent. [SEP] and i have to work out and understand it. [SEP] the angels played a game in baseball for the first time in 14 years. [SEP] [SEP]", "detok_text": "[CLS] \"he is a quiet person,\" mr. crowley says, seeming to write, at the minimum, a letter to u. s. ambassador to the house. [SEP] \"i'm not inclined to say my friends are doing the thing,\" obama said. [SEP] however, he's not coming back to the championship. [SEP] the spokesman said that it was likely that the cap, which usually includes tax increases below 2 % for drivers, included the average price of 10 per cent. [SEP] and i have to work out and understand it. [SEP] the angels played a game in baseball for the first time in 14 years. [SEP] [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] u. s., and canada. [SEP] just like ours, you can help you live better. [SEP] and i know they are well into the last seven. [SEP] since the snowboarding show opened in its entirety in 7 - 11, 2004, the peninsula hotel has been building up its own ski area for years. [SEP] they call for an investment bank to supply cash, which consumers should be able to repay at any time prior to the financial crisis. [SEP] we expect to sleep for an hour in the office, sometimes in a couple of minutes. [SEP] the purchase had been successful, he said, but from £5, 500 to [SEP]", "detok_text": "[CLS] u. s., and canada. [SEP] just like ours, you can help you live better. [SEP] and i know they are well into the last seven. [SEP] since the snowboarding show opened in its entirety in 7 - 11, 2004, the peninsula hotel has been building up its own ski area for years. [SEP] they call for an investment bank to supply cash, which consumers should be able to repay at any time prior to the financial crisis. [SEP] we expect to sleep for an hour in the office, sometimes in a couple of minutes. [SEP] the purchase had been successful, he said, but from £5, 500 to [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] after six years of \" shelling. \" [SEP] but officials say the black list could take the flight within three to five months of the target and that it has refused to have flights until friday. [SEP] he has, sometimes,, stories, stories, words, and a tendency to describe the feelings or things that have ever gone on in an instant - - and to the mixture of whole foods, real experiences, thoughts, feelings, and so deep in our blood that one, or another, is just as visible, even untimely, here. [SEP] here, head and mouth, on top of a black - covered mask. [SEP]", "detok_text": "[CLS] after six years of \"shelling.\" [SEP] but officials say the black list could take the flight within three to five months of the target and that it has refused to have flights until friday. [SEP] he has, sometimes,, stories, stories, words, and a tendency to describe the feelings or things that have ever gone on in an instant - - and to the mixture of whole foods, real experiences, thoughts, feelings, and so deep in our blood that one, or another, is just as visible, even untimely, here. [SEP] here, head and mouth, on top of a black - covered mask. [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] council spokesman bob davies said : \" the first ( and practical ) thing young people have to do is look for themselves. [SEP] that is what the majority leader, mr cameron, or mr brown, believes. [SEP] la angels at chicago, 8 : 15 p. m. [SEP] send a message, a wink, a response. [SEP] u. s. and british officials in baghdad insist the government is prepared to make a massive effort to keep these areas operating, according to military officials, including a letter to the official. [SEP] unite, which employs 400 teachers, reports from its members at least two hours a day, and employs around 22 [SEP]", "detok_text": "[CLS] council spokesman bob davies said: \" the first (and practical) thing young people have to do is look for themselves. [SEP] that is what the majority leader, mr cameron, or mr brown, believes. [SEP] la angels at chicago, 8: 15 p. m. [SEP] send a message, a wink, a response. [SEP] u. s. and british officials in baghdad insist the government is prepared to make a massive effort to keep these areas operating, according to military officials, including a letter to the official. [SEP] unite, which employs 400 teachers, reports from its members at least two hours a day, and employs around 22 [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] services. [SEP] \" john mccain is going to have to lose for us, and he is, and we will never have the chance to run for the senate, \" romney told cnn ' s website. [SEP] in order to choose from his color - - his loose - toped, cotton - out pants - - he has to open his own, even when he really warms. [SEP] so in spite of that, we have a lot to do... [SEP] because of the fact i was a public teacher. [SEP] i figured he got on the screen he ' d not feel for a long time. [SEP] not surprisingly, the [SEP]", "detok_text": "[CLS] services. [SEP] \"john mccain is going to have to lose for us, and he is, and we will never have the chance to run for the senate,\" romney told cnn's website. [SEP] in order to choose from his color - - his loose - toped, cotton - out pants - - he has to open his own, even when he really warms. [SEP] so in spite of that, we have a lot to do... [SEP] because of the fact i was a public teacher. [SEP] i figured he got on the screen he'd not feel for a long time. [SEP] not surprisingly, the [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/summary.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/summary.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..e0ce34ae20a64e44ebacaa8f6741601daba1077e --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/summary.jsonl @@ -0,0 +1,2 @@ +{"type": "summary", "name": "state_c256_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c256_t1p45", "steps": 64, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 42.24168306980635, "nll_per_token": 3.7434074840068114, "tokens": 9506}, "diversity": {"sample_entropy": 4.010304198715844, "unique_tokens": 1579, "token_count": 8192, "distinct_1": 0.1927490234375, "distinct_2": 0.6353346456692913, "top_token_mass": 0.0780029296875}} +{"type": "summary", "name": "state_c1024_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c1024_t1p45", "steps": 64, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 35.36294023649359, "nll_per_token": 3.565664385797097, "tokens": 9515}, "diversity": {"sample_entropy": 3.884623591993139, "unique_tokens": 1443, "token_count": 8192, "distinct_1": 0.1761474609375, "distinct_2": 0.5751722440944882, "top_token_mass": 0.1007080078125}} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/summary.tsv b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/summary.tsv new file mode 100644 index 0000000000000000000000000000000000000000..cd38aea630494808856013499e61cba687d74837 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_64/summary.tsv @@ -0,0 +1,3 @@ +name step detok_genppl sample_entropy distinct_2 top_token_mass model_t_mode support_power semantic_power final_from endpoint_temp concentration_max update +state_c256_t1p45 124000 42.24168306980635 4.010304198715844 0.6353346456692913 0.0780029296875 post 1.0 1.0 state 1.45 256.0 resample +state_c1024_t1p45 124000 35.36294023649359 3.884623591993139 0.5751722440944882 0.1007080078125 post 1.0 1.0 state 1.45 1024.0 resample diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/state_c1024_t1p45_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/state_c1024_t1p45_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..62e9b998209f42ba5f59469071b1e4363be4cad0 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/state_c1024_t1p45_detok_raw_samples.txt @@ -0,0 +1,228 @@ +state_c1024_t1p45_detok +{ + "type": "summary", + "name": "state_c1024_t1p45", + "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", + "step": 124000, + "decode": { + "kind": "categorical_fullvocab", + "config": "state_c1024_t1p45", + "steps": 8, + "model_t_mode": "post", + "support_power": 1.0, + "semantic_power": 1.0, + "endpoint_temp": 1.45, + "concentration_min": 1.0, + "concentration_max": 1024.0, + "final_from": "state", + "update": "resample", + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 92.67198759188139, + "nll_per_token": 4.529066243430333, + "tokens": 5494 + }, + "diversity": { + "sample_entropy": 1.7085331062756133, + "unique_tokens": 354, + "token_count": 8192, + "distinct_1": 0.043212890625, + "distinct_2": 0.1935285433070866, + "top_token_mass": 0.3070068359375 + } +} + +===== sample 000 ===== +[CLS],,,,,,,,ing, period, u,,,,,,,,,, 03,,,s, and,,, :, u.,,,,,,,,, 1, and,,,,,,,,,,,,,, :ing to the screen. [SEP] in n, n. d.: :, u,, :,,,inging, u,,,ing,,,.,, n n7,,... [SEP] poor :.. [SEP] the: : :ing to read the number :. [SEP] + +===== sample 001 ===== +[CLS] controllinging basketinginginging bulls, a basket basket -inginginginginginginginginginginging agro -ing. controllinginginginginging 89 controlling basket - dice controllinginginginginginginging control, controlling oinginging: controllinginging phinging 1ing tradersinginginginginginginging corneringinginging and dice. [SEP] totalingingingingingingingingingingingingingingingingingingingingingingingingh - controllinginginginginginginginginging in controlinginginging [SEP] + +===== sample 002 ===== +[CLS]. 1........... [SEP] 1 1 1............. 1.7.1.... 1... 111... 1,y - 1.. 1.... [SEP] 1 - 1, 1 - 1.... 1111111 1 - 1..........ly17117.........71....... [SEP] 1 1...... [SEP] + +===== sample 003 ===== +[CLS] 1 1 1h 1n 11h111 11 - 247....h 1 1 11 1 to 240 in 1. 2. we're 1 to 1 1 11.. [SEP] 1 by 11111 11 11 1.. 1hhh1hh, 1 11rh 1 11... 1 1h 1 1 11 1 in11h,.. 247 by11hhn 1n by... [SEP] 1 1 1 11..hhh 1.... 14, 1. [SEP] + +===== sample 004 ===== +[CLS] + 44 to 557 - 557, -. - - 557 - 557 -7... $100 for $77 - 607 + 4477 - 552 db's plan was: - - -7.. -, - - - -,, - - -, 55 -, 55 - 55 -, -, - - a,, 37, 37,,,,, -,, 55 - 48, 73 -, -,, 49 - 55. 55 -,,,,, 55,, 557,,,,7,,,7 - - [SEP] + +===== sample 005 ===== +[CLS] time. [SEP] the,,,,,s, but, the number,,,,,,,,,,,s. [SEP] the u's,,,,,,, 55, 000,,,, and the,,,,,,,,,,,,,,,,a to,,,, oh,,,,, oh, stretching,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP] + +===== sample 006 ===== +[CLS]iherherthertherherioeaaaeherheraherheraiterititi, oherherherherheritherherheraitherheraherherherheritherither,herhera. bitit,heritherherherherherheritit, upi,herheritherheraherititiatii, siits, oiti. [SEP] what: :: :it n to bullsi,, and &: andher. ting, u's u ini. [SEP] the [SEP] + +===== sample 007 ===== +[CLS]..1, 24771 - 2477777....7777771777..7.777777777777....777771..71..77777777... [SEP] 37777777777.....7777..7777.71 to 24777777......7...77 in the7, 247.. [SEP] + +===== sample 008 ===== +[CLS],, s, s, s,,, s,, s, g,,,,,.. 247,,, 1, s, 1, s, s, s, n, g,, s, n, d, s,, s, d,, s, s, d, n,,,,,,ing in 1, 179. [SEP] 1 17,71111, s,.. 247 1, 1,, 247,,, 21,1, s,,19,1, n,11111.1 [SEP] + +===== sample 009 ===== +[CLS], n,,,,,,,,,,, and,,,,,,, oh, oh, fl,, and the u,,, oh,....,,,,,,,,,, 51, 73, 48, 58,,,, 47,,,,,,, 89,,,,,,,,,,,,, 51,,,,,, etc.,, 51, n, etc.,,,,,,,,,,,, etc..,,,,..,,,.. [SEP] + +===== sample 010 ===== +[CLS] g u u u n 6 u u n n u u u n u u u u n u u w u u u u u u1. 6 u u u 6 u n u w n u - u. u u n n n. 6 n 6 6 n u n n n n n n n u u u n u u. g 6 g w 6, 731, u - 6 6 6 w ticks, n u u n u, u n u. h u n u u u u n u u n n u u u. u u u u u u u u u n u - [SEP] + +===== sample 011 ===== +[CLS],,,,,,,,,,,,,,,,,,,, to,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, the,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, d -,,,,,,,,,,,,,,,, [SEP] + +===== sample 012 ===== +[CLS] s d 2.177 2477,177,771177717171. [SEP] d1777,11, 2471 131 in, 1, 24717.. 2477771... 14777777, 141....77777711777771.. [SEP] 147777771.77777771. d711117117717.717.. [SEP] + +===== sample 013 ===== +[CLS] to to to t to to to to to toaatsi to to to toaaicia logic to ciceroii, ticiaiciaiciaiiiniinging toh toar min min }ing mining minyher in the bulls ofy... [SEP] min minuinginga. ts t taaaa toa tohero performance support.. -her to toaa toath, ngreeaaaiiaiaa }aaiataingaai taay tinging oaa naa -: [SEP] + +===== sample 014 ===== +[CLS],s, manhattan, no,s, court, anditing to each other. the,,,,,, and, and and and in in basket. [SEP] cot in the name of the bunsit andiing.ys,, what,it, u..., don't have to the point andiny, oy and,heri, o,it, oit, the futureiniaitherit. t and &,,, & o oitit and no,,,,, and, otms. [SEP] the ramp of of thes look [SEP] + +===== sample 015 ===== +[CLS]a controllinging of the cornering foring............. controllinginging %t,o.....t n,1h n tying 17.....a real ninghinginging,ingingersining..... lockheedinging nohhinging.... controllinginging1hing,,y.ing. oniec.... [SEP] ph: :, :, number of controlinging,ingingt for a.,inging, n,inginging [SEP] + +===== sample 016 ===== +[CLS] n 1 n n s1 s s.1 n n111 s n111, n., n1 n s1 in n n n, n. s n1, n1 n h ). h n n1 n1, n, n17 n. n1,1, n n. n.11 n n1 - n1 n11111.. h n n n } n n1.17 n11 n n1 n1 n11 n n h n s n1 n n.., n of n n1 s [SEP] + +===== sample 017 ===== +[CLS] d. 1 01 1... [SEP] dly77.. 247.77.777.7, 247111 to 247171. 2471777777177777777777117..777.1. [SEP] d...7777777777177777 in the 1.7777777117777 to the..77...717....77,. [SEP] + +===== sample 018 ===== +[CLS] warranty,,,,,,,,,,,,,,,,,,,s, number, and,,,,ing to.... the number,,,,,,,,,, number,,it, nope, oh,,,, controlling,ing. o,,,,,ing of,it for, in &,,,,, for theititit. the group,,,itit,, of,,,,,,,,,,,,,it,,,,it, for periodititit.. [SEP] + +===== sample 019 ===== +[CLS],,,,,,,,,,,,,, n,,,,,,,,,,,,,,,,,,,,,'s,,,,,.,,, b,,, sant,,,,,,,,,, s.,,,, n.,,,,,,, neo -,,,,,,,,,,,,,,,,,,, 14 - 08. [SEP] the fate of the economy,,,,,,,,,,,,,,,,,, [SEP] + +===== sample 020 ===== +[CLS],,,, t -,, number,, cu,, double - off, o,,,,, for wheels. [SEP] the number of, oftm,,,,,,,,,,, for a,, and ticker, in a basket,,,,,,,,. b,,,,, for,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, a,,,,,,, [SEP] + +===== sample 021 ===== +[CLS], bulls, u and andt of, o.. and ot. anding o & and,,, - and.....: and u & o uers and.es, and o, and and, ticking anding anding to and for.. [SEP] " we have have a lot of oing, u in o,inging,,,,inginging,,,, fors. [SEP] u: o. with..ing. o....ing and,.., anding u... [SEP] the: :: and o to the. [SEP] + +===== sample 022 ===== +[CLS]7771. 081875k1 08777726877267777777726777,771 - 49777787777.. wx777268277777. number7777778. - ilk. numberyb26267777777777777777267777777771177 tool to7777 ath7777. 49 [SEP] + +===== sample 023 ===== +[CLS]ttttttttittaittitaititaititititheritherherherherititititheritititititherititherherititherherheritherita. bherheraheraherheraherherherherherherheraherheraherherherherheraitheritherad to beherititherherherher - oherherthertt of the number ofit natal in the cbherher for $150, 000yitit period. [SEP] the the [SEP] + +===== sample 024 ===== +[CLS]., oh,,,,,,, oh,,,,,,,,,,,,,, oregon,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, 48 - 89,,,,,...,,,,,, 48,,,,,,,,,,,,,, furs to be,,,,,,,,,,,,, 52,,,,,,,,,,,,, [SEP] + +===== sample 025 ===== +[CLS] :,it - 05, 000, sf, inher,,ing,,,herherheritits. [SEP] use e - zherythatattitt number ofitit.... rnaanditits to aeherittthert number $1. 00..tiniainia to agree onitityitheritit skill. [SEP] butititit in the u..herherherherherherititititherhertherheritheritititit, theheritititit..herherit.. [SEP] + +===== sample 026 ===== +[CLS],,,,, world and the,,, rest - -,,,,,,,,,, etc. [SEP] for the,,,,, alike, it was a,,,,,,,,,,,,,,,,,,, etc. [SEP] the number of the, is is is and, and banking, is, of the road. [SEP] the the,s, the,,,, and,, with the same andy,, defends against the sight of the 14. [SEP] the worst is is is of the america's neighbours, the the, [SEP] + +===== sample 027 ===== +[CLS] 2.......................... -y - 247.....................7.........7.,.................1. d7 and 1.............. [SEP] year...................... [SEP] + +===== sample 028 ===== +[CLS]. -. judges.. judges n,sicia in...iciaiciaiciaiciaiciaiciaiciaicia.icia n, t.icia.icia., siciaiciaiciaiciaicia.. - - judges.iciaiciaiciaiciaiciaicia... to the group...iciaiciaiciaiciaiciaiciaiciaicia..... insiciaiciaiciaiciaiciaiciaiciaiciaiciaiciaiciaicia..iciaicia in... [SEP] n in iniciaicia. in n, n in n..iciaiciaicia..icia., - - o..., [SEP] + +===== sample 029 ===== +[CLS]........................, s........... o, s....... dice..... [SEP] in....................... [SEP] the date in,...... 07 to n.1, 07........... s1, 2, s............. [SEP] + +===== sample 030 ===== +[CLS],,,, and,, ). [SEP] the: :,,,,, and 14 - 74 %. [SEP] i: : :, and, and,,. options. [SEP] using: :,ing, u,,ing,ing, n,, 1,,,,,,ing and u,,,,,,,,,,, controlling,,,,,,,,, n,,,,, the number,,,,,,,,,,,, o,,,,,,,,,,,,, and,,,,: [SEP] + +===== sample 031 ===== +[CLS].. [SEP] in a -ti -o - like -it -it - - and -it in theing andittm. -hat &.t -..... [SEP] a the, one of the neherher and andtm, and,, and wasit, of the nightherthit's control, theo, and,lon, &, and the fancy and & andhat realaleob and & cu and heleneher -itits. [SEP] some,t - good words. [SEP] the the,,, of the country, the, and, to ands. [SEP] [SEP] + +===== sample 032 ===== +[CLS].. work for me, " said mcguire, who,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, on,,,,,,,,,,,....,,,,,,,,, -,,,,,, has become an arch...... of, that is means to,,,,,,,,,,,,,,, to.. [SEP] the u. s. is is,... [SEP] [SEP] + +===== sample 033 ===== +[CLS]........................ p's...... [SEP] 14.......7.....7.71 in n1 - 247..7..... 247.771,...17.....1711.... [SEP] 247..71..... 247.1..71711 n1, 247.1111, 247...1 - [SEP] + +===== sample 034 ===== +[CLS]....... and starttt.......tttttttt....tinia11art........ttntttandtttiandandtiniatanditandl.....andiniatthttandt herotttt with the nameaecars.ttin......andtandt..11andinin to get the numbert......ttand unprecedentedandtt11.. [SEP] + +===== sample 035 ===== +[CLS],,,,,,,,,,,,,, unable to,,,,,,,,,,,,,,,,,,,,,,, -,,,,, of,,,,,,, a,,,,,,,,,,,,,,,,,,,.. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,, the,,,,,,,,,,,,,,,,,,, [SEP] + +===== sample 036 ===== +[CLS] s. 00 dice1: 13 dice and dice. dice. s dice dice1 dice1.. dice dice. dice..11. dice. 08 dice dice dice }. }. wizard of dice dice dice dice dice dice dice. the ph of dice... }. dice dice dice dice 247 dice dice } }.. } dice dice. dice dice }7 dice dice dice dice } dice.. dice dice dice dice1 dice } dice dice17 dice. } } dice dice. dice dice7 dice dice } dice dice dice } dice7 dice dice dice dice dice. dice. dice. [SEP] + +===== sample 037 ===== +[CLS],,, and and and there was a good - tot,, amongst, and.. [SEP] roadher - & &herherherherit to -,, &herherit andhatit andit &, andher regulation oft and and and and and andherherheritits. [SEP] the :, andher,,, and,it, theheriherher, and the bullstherher,,, and and and and andherher in the end. [SEP] the bad is a,, and,, and and in the point of the.. [SEP] he's a [SEP] + +===== sample 038 ===== +[CLS] in the u,, -,,, -,,,,,,,,,,,andution.o. com. [SEP] ph :,,,,,,,,, and u. s.,,,,,,,,,,,,,,,,, o. v.,,,, positive,,,,,,,,,, u -sts,,,,,,,, number of,,,,,, n. u.,,,,,, in, non - - u... e - -,,,, [SEP] + +===== sample 039 ===== +[CLS], basket, o &ed,y,,y,,y,yy in,,ooyyooo white in the basketoyyt substitution ofitito,ititit basket - 98. [SEP] " i want to see theit and in the bulls -it what in the holyiiaooititi,o,oitoooi perioditito - tested,ooy,,,oito and useiy forit in the goody,,i,,,,o,,,,,ooo, [SEP] + +===== sample 040 ===== +[CLS],,,,,,,,, 192 -, 14 - 192, 14 -,,,,,,,,,,,,,, 14, 14, 192. 73 -, number of 51, 37, 37 13, 000. + 1,, -,,,,, 192, 192, 37, 73.,, 192, 372, 192, 192, 192, 192, 51, 192,,2, 49, 192, 192,,,,,,,, 192,,,,,,, 192,,,,,,,,,,7, [SEP] + +===== sample 041 ===== +[CLS] a little number of numbers, in the process, of... [SEP] bulls -i - o -,,to, bullsher o,te, u, o, t o, for b,, and os, including g t. n. non - o t - - n.s. [SEP] the bulls - :iher,,,, o.,,,herhi o,,,, oh, and a osi,, ohing. [SEP] n: :ia -, o oi. o o n. o. o u n -.. [SEP] + +===== sample 042 ===== +[CLS].............................................................7,..... to.1, 1............................. work in time................ [SEP] year... [SEP] + +===== sample 043 ===== +[CLS]...... of 1. 3. 1. 1...................... 247 1 1 a day, 1 1 1 1 3 1 1, 1 1... [SEP] 1 a 1, 247 1 1 1 1. 247 1..... 247. 1. a...... 1.......... a.......... 1 a..... 247's 1......... [SEP] + +===== sample 044 ===== +[CLS],,,,,,, number of,,,,,,,,, a number of,,.,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,ing. [SEP] the :, on,,,,.. [SEP] the number number,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, to,,,,,,,,,,, to,,,ing to,,, u. [SEP] + +===== sample 045 ===== +[CLS].. ). [SEP] street -ulator, theaebububu - mgs -any -itbububububu -buanybububuanybububububuanybububububuanybububububububububububu - - -anyitbuanyanyanyanyanyanybu -bubu -buitbuoba. [SEP] family -bu - -anyae -yanyany -anyanybu -anyanyy -anyanyanbububububuanititdan - whaz -an -bubububububu [SEP] + +===== sample 046 ===== +[CLS].. i think of,, back to the limit,,,,,,,.,,,,,,,,, to,,,,,,, of,.,,,,,.,,,,,, and extreme,,,, re - - the country,,,,,,,,,,,,,,,...,,,,,,,,,,,,,,,,,,,,,,,,, to,,,,,,,,,,,,,, grinds and games, [CLS] [SEP] + +===== sample 047 ===== +[CLS],,,s, u,.. [SEP],,,, [SEP],,,,,,,,.. [SEP] they,y - reserve, u,,,,,,,,,s of the way,,,y, prime, a quick, out of the american,,,,,,,,,,,, in the, basket, two,,,,,,,, no - and,,,,,, andits... on in the definition of the universe. [SEP] the opecs s havesss,, the ultimate concept of the [SEP] + +===== sample 048 ===== +[CLS] the, of the world,,,,,, in the,,,,,,,,,,,,,,,,,,,,,,,, non -,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, of the oh,,, to,,,,,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,, [SEP] + +===== sample 049 ===== +[CLS] and and,, and and way of the basket. [SEP] no,, boston. [SEP] in 1 -,, and, and have have changed their names from number to 14 - 14, 14, 14, 14, to,, to,,,, and,, 14. [SEP] thewi is ends with a 14 - yard view in the top of the road and for the first time and - - between point in place. [SEP] a have one -,s... [SEP] a -,,,in, upt,.9. [SEP] it was last modified at 21. 54 gmt on monday 13 february [SEP] + +===== sample 050 ===== +[CLS] were way out from the basket. [SEP] the al hundreds like,t datet.tmical,. and.es. [SEP] the the vinnie, thetni and a no -htt andt of the lot of thetm and andt atta of the corner. [SEP] the thettt tt and sacredat and &tther of the bestt of the day. [SEP] but the realherherher,hertherhher,ith,,.ht,,.h,httth for the numberttat anda of the [SEP] + +===== sample 051 ===== +[CLS],,,,,,,,,,,,,,,,,,,,,, [CLS]. [SEP] the whole is,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and h. [SEP],, 116,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,,,,,,,,,,,,,,,,, the idea of the total, [SEP] + +===== sample 052 ===== +[CLS].................tt,..t the numberst -......tt................... in the................... [SEP] 2 :.t.......tttt.....t............................. [SEP] + +===== sample 053 ===== +[CLS].. g.1.1.11,.. 247. s7177. 1111,,,.,017711 g,., 2471,,11,,11,1, s11117, g11 52, 731, s 6, 247,, s,1, w,,11, d and g,11,1, g1,y, n, n,,1,,, n71 n,, n,y1 in h. g.11,.. [SEP] + +===== sample 054 ===== +[CLS] [SEP] s... time................................1 to................................, n.................... n............................... [SEP] + +===== sample 055 ===== +[CLS] for a meal. [SEP] il: : criminals, u......... flexi..........er. o.n.,....t for....,,er, on........ &er, no,,r and,..... and... [SEP]........ for...o............... [SEP] but by.............. [SEP] + +===== sample 056 ===== +[CLS]...................,..........................t -...........ho, no.............ining in the holy...............t.........1.,t.... [SEP] the forulatory, /,. by,. [SEP] + +===== sample 057 ===== +[CLS], t os in the u...... jobs. nhi.ing.ing.torsing,ing ininginging.... the bulls ofinging...ing.ing........,,a in n. [SEP] n :y drugs, 000 bulls,ing,,,,.,,,inging,,inging. ning,,inging,inging......,a... point,.............. :,ing, n [SEP] + +===== sample 058 ===== +[CLS] of the remaining,,,,,,,its, the sly, o,,,,,,, so, usd,, non -,,,,,,,, o, n,,,,,. o,,,,,,,,, and,,,,,,,,, and,,,,,,,,,. o,,,,,,,,,,,,,,,,,,,,,,,, o, a,,,, o,,a. o,,,,,,,,,, [SEP] + +===== sample 059 ===== +[CLS]... [SEP] year.......,...... dice - n............. u's. n in n.................................... n, n....................... rules in n................... [SEP] + +===== sample 060 ===== +[CLS],,,,,,, of the,,,,,itit, pro - vs - back, and,,,it, and,,, and,,,,,,,,, anditra. [SEP] for iran, the,t on drugs and charges in the end and and, in the world. [SEP] some,,,,,,,,,,,,,it, and and out of the warrant andt the rest of the day. [SEP] a, and,,,, in thes of the bulls. s. [SEP] and,,,,,,,, [SEP] + +===== sample 061 ===== +[CLS], oh, spread, fat,,,,,,,,,,,,,,, a,,,,,,tric, 51, t,, and total,ing,,,,,,,,it, o, n, oh, t, 95,,,,,,,,,,,,,,,,,,,,,,, and,,,,,,it of the number,it. mosther,,it, to,,and,,,,and,,,,,,it,,,,,,,er, [SEP] + +===== sample 062 ===== +[CLS] end, it is likely to be a for 1 for for period. [SEP] 2 u of for for,,, for,,,,.. u,,,,, u,,,,,,, g,,er,er to 1, u, up,, u, for. for for up for for for up for u for for.. [SEP] u foring up,ing, and for ofing,, a g, for -er in the u of,, o,, u,, u, time,, u, u, for. g for up. u up.. [SEP] + +===== sample 063 ===== +[CLS].................. by by by. an 1, 1. 1 tod...n7..... [SEP] at by a.................1nnn...d a. ad......nn a... a.nnn...nnn............................. [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/state_c1024_t1p45_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/state_c1024_t1p45_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..ee699bf67732220461fdc2923926013dc7953dd3 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/state_c1024_t1p45_raw_samples.txt @@ -0,0 +1,228 @@ +state_c1024_t1p45 +{ + "type": "summary", + "name": "state_c1024_t1p45", + "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", + "step": 124000, + "decode": { + "kind": "categorical_fullvocab", + "config": "state_c1024_t1p45", + "steps": 8, + "model_t_mode": "post", + "support_power": 1.0, + "semantic_power": 1.0, + "endpoint_temp": 1.45, + "concentration_min": 1.0, + "concentration_max": 1024.0, + "final_from": "state", + "update": "resample", + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 92.67198759188139, + "nll_per_token": 4.529066243430333, + "tokens": 5494 + }, + "diversity": { + "sample_entropy": 1.7085331062756133, + "unique_tokens": 354, + "token_count": 8192, + "distinct_1": 0.043212890625, + "distinct_2": 0.1935285433070866, + "top_token_mass": 0.3070068359375 + } +} + +===== sample 000 ===== +[CLS],,,,,,,,ing, period, u,,,,,,,,,, 03,,,s, and,,, :, u.,,,,,,,,, 1, and,,,,,,,,,,,,,, :ing to the screen. [SEP] in n, n. d. : :, u,, :,,,inging, u,,,ing,,,.,, n n7,,... [SEP] poor :.. [SEP] the : : :ing to read the number :. [SEP] + +===== sample 001 ===== +[CLS] controllinging basketinginginging bulls, a basket basket -inginginginginginginginginginginging agro -ing. controllinginginginginging 89 controlling basket - dice controllinginginginginginginging control, controlling oinginging : controllinginging phinging 1ing tradersinginginginginginginging corneringinginging and dice. [SEP] totalingingingingingingingingingingingingingingingingingingingingingingingingh - controllinginginginginginginginginging in controlinginginging [SEP] + +===== sample 002 ===== +[CLS]. 1........... [SEP] 1 1 1............. 1.7.1.... 1... 111... 1,y - 1.. 1.... [SEP] 1 - 1, 1 - 1.... 1111111 1 - 1..........ly17117.........71....... [SEP] 1 1...... [SEP] + +===== sample 003 ===== +[CLS] 1 1 1h 1n 11h111 11 - 247....h 1 1 11 1 to 240 in 1. 2. we ' re 1 to 1 1 11.. [SEP] 1 by 11111 11 11 1.. 1hhh1hh, 1 11rh 1 11... 1 1h 1 1 11 1 in11h,.. 247 by11hhn 1n by... [SEP] 1 1 1 11..hhh 1.... 14, 1. [SEP] + +===== sample 004 ===== +[CLS] + 44 to 557 - 557, -. - - 557 - 557 -7... $ 100 for $77 - 607 + 4477 - 552 db ' s plan was : - - -7.. -, - - - -,, - - -, 55 -, 55 - 55 -, -, - - a,, 37, 37,,,,, -,, 55 - 48, 73 -, -,, 49 - 55. 55 -,,,,, 55,, 557,,,,7,,,7 - - [SEP] + +===== sample 005 ===== +[CLS] time. [SEP] the,,,,,s, but, the number,,,,,,,,,,,s. [SEP] the u ' s,,,,,,, 55, 000,,,, and the,,,,,,,,,,,,,,,,a to,,,, oh,,,,, oh, stretching,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP] + +===== sample 006 ===== +[CLS]iherherthertherherioeaaaeherheraherheraiterititi, oherherherherheritherherheraitherheraherherherheritherither,herhera. bitit,heritherherherherherheritit, upi,herheritherheraherititiatii, siits, oiti. [SEP] what : : : :it n to bullsi,, and & : andher. ting, u ' s u ini. [SEP] the [SEP] + +===== sample 007 ===== +[CLS]..1, 24771 - 2477777....7777771777..7.777777777777....777771..71..77777777... [SEP] 37777777777.....7777..7777.71 to 24777777......7...77 in the7, 247.. [SEP] + +===== sample 008 ===== +[CLS],, s, s, s,,, s,, s, g,,,,,.. 247,,, 1, s, 1, s, s, s, n, g,, s, n, d, s,, s, d,, s, s, d, n,,,,,,ing in 1, 179. [SEP] 1 17,71111, s,.. 247 1, 1,, 247,,, 21,1, s,,19,1, n,11111.1 [SEP] + +===== sample 009 ===== +[CLS], n,,,,,,,,,,, and,,,,,,, oh, oh, fl,, and the u,,, oh,....,,,,,,,,,, 51, 73, 48, 58,,,, 47,,,,,,, 89,,,,,,,,,,,,, 51,,,,,, etc.,, 51, n, etc.,,,,,,,,,,,, etc..,,,,..,,,.. [SEP] + +===== sample 010 ===== +[CLS] g u u u n 6 u u n n u u u n u u u u n u u w u u u u u u1. 6 u u u 6 u n u w n u - u. u u n n n. 6 n 6 6 n u n n n n n n n u u u n u u. g 6 g w 6, 731, u - 6 6 6 w ticks, n u u n u, u n u. h u n u u u u n u u n n u u u. u u u u u u u u u n u - [SEP] + +===== sample 011 ===== +[CLS],,,,,,,,,,,,,,,,,,,, to,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, the,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, d -,,,,,,,,,,,,,,,, [SEP] + +===== sample 012 ===== +[CLS] s d 2.177 2477,177,771177717171. [SEP] d1777,11, 2471 131 in, 1, 24717.. 2477771... 14777777, 141....77777711777771.. [SEP] 147777771.77777771. d711117117717.717.. [SEP] + +===== sample 013 ===== +[CLS] to to to t to to to to to toaatsi to to to toaaicia logic to ciceroii, ticiaiciaiciaiiiniinging toh toar min min }ing mining minyher in the bulls ofy... [SEP] min minuinginga. ts t taaaa toa tohero performance support.. -her to toaa toath, ngreeaaaiiaiaa }aaiataingaai taay tinging oaa naa - : [SEP] + +===== sample 014 ===== +[CLS],s, manhattan, no,s, court, anditing to each other. the,,,,,, and, and and and in in basket. [SEP] cot in the name of the bunsit andiing.ys,, what,it, u..., don ' t have to the point andiny, oy and,heri, o,it, oit, the futureiniaitherit. t and &,,, & o oitit and no,,,,, and, otms. [SEP] the ramp of of thes look [SEP] + +===== sample 015 ===== +[CLS]a controllinging of the cornering foring............. controllinginging %t,o.....t n,1h n tying 17.....a real ninghinginging,ingingersining..... lockheedinging nohhinging.... controllinginging1hing,,y.ing. oniec.... [SEP] ph : :, :, number of controlinging,ingingt for a.,inging, n,inginging [SEP] + +===== sample 016 ===== +[CLS] n 1 n n s1 s s.1 n n111 s n111, n., n1 n s1 in n n n, n. s n1, n1 n h ). h n n1 n1, n, n17 n. n1,1, n n. n.11 n n1 - n1 n11111.. h n n n } n n1.17 n11 n n1 n1 n11 n n h n s n1 n n.., n of n n1 s [SEP] + +===== sample 017 ===== +[CLS] d. 1 01 1... [SEP] dly77.. 247.77.777.7, 247111 to 247171. 2471777777177777777777117..777.1. [SEP] d...7777777777177777 in the 1.7777777117777 to the..77...717....77,. [SEP] + +===== sample 018 ===== +[CLS] warranty,,,,,,,,,,,,,,,,,,,s, number, and,,,,ing to.... the number,,,,,,,,,, number,,it, nope, oh,,,, controlling,ing. o,,,,,ing of,it for, in &,,,,, for theititit. the group,,,itit,, of,,,,,,,,,,,,,it,,,,it, for periodititit.. [SEP] + +===== sample 019 ===== +[CLS],,,,,,,,,,,,,, n,,,,,,,,,,,,,,,,,,,,, ' s,,,,,.,,, b,,, sant,,,,,,,,,, s.,,,, n.,,,,,,, neo -,,,,,,,,,,,,,,,,,,, 14 - 08. [SEP] the fate of the economy,,,,,,,,,,,,,,,,,, [SEP] + +===== sample 020 ===== +[CLS],,,, t -,, number,, cu,, double - off, o,,,,, for wheels. [SEP] the number of, oftm,,,,,,,,,,, for a,, and ticker, in a basket,,,,,,,,. b,,,,, for,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, a,,,,,,, [SEP] + +===== sample 021 ===== +[CLS], bulls, u and andt of, o.. and ot. anding o & and,,, - and..... : and u & o uers and.es, and o, and and, ticking anding anding to and for.. [SEP] " we have have a lot of oing, u in o,inging,,,,inginging,,,, fors. [SEP] u : o. with..ing. o....ing and,.., anding u... [SEP] the : : : and o to the. [SEP] + +===== sample 022 ===== +[CLS]7771. 081875k1 08777726877267777777726777,771 - 49777787777.. wx777268277777. number7777778. - ilk. numberyb26267777777777777777267777777771177 tool to7777 ath7777. 49 [SEP] + +===== sample 023 ===== +[CLS]ttttttttittaittitaititaititititheritherherherherititititheritititititherititherherititherherheritherita. bherheraheraherheraherherherherherherheraherheraherherherherheraitheritherad to beherititherherherher - oherherthertt of the number ofit natal in the cbherher for $ 150, 000yitit period. [SEP] the the [SEP] + +===== sample 024 ===== +[CLS]., oh,,,,,,, oh,,,,,,,,,,,,,, oregon,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, 48 - 89,,,,,...,,,,,, 48,,,,,,,,,,,,,, furs to be,,,,,,,,,,,,, 52,,,,,,,,,,,,, [SEP] + +===== sample 025 ===== +[CLS] :,it - 05, 000, sf, inher,,ing,,,herherheritits. [SEP] use e - zherythatattitt number ofitit.... rnaanditits to aeherittthert number $ 1. 00..tiniainia to agree onitityitheritit skill. [SEP] butititit in the u..herherherherherherititititherhertherheritheritititit, theheritititit..herherit.. [SEP] + +===== sample 026 ===== +[CLS],,,,, world and the,,, rest - -,,,,,,,,,, etc. [SEP] for the,,,,, alike, it was a,,,,,,,,,,,,,,,,,,, etc. [SEP] the number of the, is is is and, and banking, is, of the road. [SEP] the the,s, the,,,, and,, with the same andy,, defends against the sight of the 14. [SEP] the worst is is is of the america ' s neighbours, the the, [SEP] + +===== sample 027 ===== +[CLS] 2.......................... -y - 247.....................7.........7.,.................1. d7 and 1.............. [SEP] year...................... [SEP] + +===== sample 028 ===== +[CLS]. -. judges.. judges n,sicia in...iciaiciaiciaiciaiciaiciaiciaicia.icia n, t.icia.icia., siciaiciaiciaiciaicia.. - - judges.iciaiciaiciaiciaiciaicia... to the group...iciaiciaiciaiciaiciaiciaiciaicia..... insiciaiciaiciaiciaiciaiciaiciaiciaiciaiciaiciaicia..iciaicia in... [SEP] n in iniciaicia. in n, n in n..iciaiciaicia..icia., - - o..., [SEP] + +===== sample 029 ===== +[CLS]........................, s........... o, s....... dice..... [SEP] in....................... [SEP] the date in,...... 07 to n.1, 07........... s1, 2, s............. [SEP] + +===== sample 030 ===== +[CLS],,,, and,, ). [SEP] the : :,,,,, and 14 - 74 %. [SEP] i : : :, and, and,,. options. [SEP] using : :,ing, u,,ing,ing, n,, 1,,,,,,ing and u,,,,,,,,,,, controlling,,,,,,,,, n,,,,, the number,,,,,,,,,,,, o,,,,,,,,,,,,, and,,,, : [SEP] + +===== sample 031 ===== +[CLS].. [SEP] in a -ti -o - like -it -it - - and -it in theing andittm. -hat &.t -..... [SEP] a the, one of the neherher and andtm, and,, and wasit, of the nightherthit ' s control, theo, and,lon, &, and the fancy and & andhat realaleob and & cu and heleneher -itits. [SEP] some,t - good words. [SEP] the the,,, of the country, the, and, to ands. [SEP] [SEP] + +===== sample 032 ===== +[CLS].. work for me, " said mcguire, who,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, on,,,,,,,,,,,....,,,,,,,,, -,,,,,, has become an arch...... of, that is means to,,,,,,,,,,,,,,, to.. [SEP] the u. s. is is,... [SEP] [SEP] + +===== sample 033 ===== +[CLS]........................ p ' s...... [SEP] 14.......7.....7.71 in n1 - 247..7..... 247.771,...17.....1711.... [SEP] 247..71..... 247.1..71711 n1, 247.1111, 247...1 - [SEP] + +===== sample 034 ===== +[CLS]....... and starttt.......tttttttt....tinia11art........ttntttandtttiandandtiniatanditandl.....andiniatthttandt herotttt with the nameaecars.ttin......andtandt..11andinin to get the numbert......ttand unprecedentedandtt11.. [SEP] + +===== sample 035 ===== +[CLS],,,,,,,,,,,,,, unable to,,,,,,,,,,,,,,,,,,,,,,, -,,,,, of,,,,,,, a,,,,,,,,,,,,,,,,,,,.. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,, the,,,,,,,,,,,,,,,,,,, [SEP] + +===== sample 036 ===== +[CLS] s. 00 dice1 : 13 dice and dice. dice. s dice dice1 dice1.. dice dice. dice..11. dice. 08 dice dice dice }. }. wizard of dice dice dice dice dice dice dice. the ph of dice... }. dice dice dice dice 247 dice dice } }.. } dice dice. dice dice }7 dice dice dice dice } dice.. dice dice dice dice1 dice } dice dice17 dice. } } dice dice. dice dice7 dice dice } dice dice dice } dice7 dice dice dice dice dice. dice. dice. [SEP] + +===== sample 037 ===== +[CLS],,, and and and there was a good - tot,, amongst, and.. [SEP] roadher - & &herherherherit to -,, &herherit andhatit andit &, andher regulation oft and and and and and andherherheritits. [SEP] the :, andher,,, and,it, theheriherher, and the bullstherher,,, and and and and andherher in the end. [SEP] the bad is a,, and,, and and in the point of the.. [SEP] he ' s a [SEP] + +===== sample 038 ===== +[CLS] in the u,, -,,, -,,,,,,,,,,,andution.o. com. [SEP] ph :,,,,,,,,, and u. s.,,,,,,,,,,,,,,,,, o. v.,,,, positive,,,,,,,,,, u -sts,,,,,,,, number of,,,,,, n. u.,,,,,, in, non - - u... e - -,,,, [SEP] + +===== sample 039 ===== +[CLS], basket, o &ed,y,,y,,y,yy in,,ooyyooo white in the basketoyyt substitution ofitito,ititit basket - 98. [SEP] " i want to see theit and in the bulls -it what in the holyiiaooititi,o,oitoooi perioditito - tested,ooy,,,oito and useiy forit in the goody,,i,,,,o,,,,,ooo, [SEP] + +===== sample 040 ===== +[CLS],,,,,,,,, 192 -, 14 - 192, 14 -,,,,,,,,,,,,,, 14, 14, 192. 73 -, number of 51, 37, 37 13, 000. + 1,, -,,,,, 192, 192, 37, 73.,, 192, 372, 192, 192, 192, 192, 51, 192,,2, 49, 192, 192,,,,,,,, 192,,,,,,, 192,,,,,,,,,,7, [SEP] + +===== sample 041 ===== +[CLS] a little number of numbers, in the process, of... [SEP] bulls -i - o -,,to, bullsher o,te, u, o, t o, for b,, and os, including g t. n. non - o t - - n.s. [SEP] the bulls - :iher,,,, o.,,,herhi o,,,, oh, and a osi,, ohing. [SEP] n : :ia -, o oi. o o n. o. o u n -.. [SEP] + +===== sample 042 ===== +[CLS].............................................................7,..... to.1, 1............................. work in time................ [SEP] year... [SEP] + +===== sample 043 ===== +[CLS]...... of 1. 3. 1. 1...................... 247 1 1 a day, 1 1 1 1 3 1 1, 1 1... [SEP] 1 a 1, 247 1 1 1 1. 247 1..... 247. 1. a...... 1.......... a.......... 1 a..... 247 ' s 1......... [SEP] + +===== sample 044 ===== +[CLS],,,,,,, number of,,,,,,,,, a number of,,.,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,ing. [SEP] the :, on,,,,.. [SEP] the number number,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, to,,,,,,,,,,, to,,,ing to,,, u. [SEP] + +===== sample 045 ===== +[CLS].. ). [SEP] street -ulator, theaebububu - mgs -any -itbububububu -buanybububuanybububububuanybububububuanybububububububububububu - - -anyitbuanyanyanyanyanyanybu -bubu -buitbuoba. [SEP] family -bu - -anyae -yanyany -anyanybu -anyanyy -anyanyanbububububuanititdan - whaz -an -bubububububu [SEP] + +===== sample 046 ===== +[CLS].. i think of,, back to the limit,,,,,,,.,,,,,,,,, to,,,,,,, of,.,,,,,.,,,,,, and extreme,,,, re - - the country,,,,,,,,,,,,,,,...,,,,,,,,,,,,,,,,,,,,,,,,, to,,,,,,,,,,,,,, grinds and games, [CLS] [SEP] + +===== sample 047 ===== +[CLS],,,s, u,.. [SEP],,,, [SEP],,,,,,,,.. [SEP] they,y - reserve, u,,,,,,,,,s of the way,,,y, prime, a quick, out of the american,,,,,,,,,,,, in the, basket, two,,,,,,,, no - and,,,,,, andits... on in the definition of the universe. [SEP] the opecs s havesss,, the ultimate concept of the [SEP] + +===== sample 048 ===== +[CLS] the, of the world,,,,,, in the,,,,,,,,,,,,,,,,,,,,,,,, non -,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, of the oh,,, to,,,,,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,, [SEP] + +===== sample 049 ===== +[CLS] and and,, and and way of the basket. [SEP] no,, boston. [SEP] in 1 -,, and, and have have changed their names from number to 14 - 14, 14, 14, 14, to,, to,,,, and,, 14. [SEP] thewi is ends with a 14 - yard view in the top of the road and for the first time and - - between point in place. [SEP] a have one -,s... [SEP] a -,,,in, upt,.9. [SEP] it was last modified at 21. 54 gmt on monday 13 february [SEP] + +===== sample 050 ===== +[CLS] were way out from the basket. [SEP] the al hundreds like,t datet.tmical,. and.es. [SEP] the the vinnie, thetni and a no -htt andt of the lot of thetm and andt atta of the corner. [SEP] the thettt tt and sacredat and &tther of the bestt of the day. [SEP] but the realherherher,hertherhher,ith,,.ht,,.h,httth for the numberttat anda of the [SEP] + +===== sample 051 ===== +[CLS],,,,,,,,,,,,,,,,,,,,,, [CLS]. [SEP] the whole is,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and h. [SEP],, 116,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,,,,,,,,,,,,,,,,, the idea of the total, [SEP] + +===== sample 052 ===== +[CLS].................tt,..t the numberst -......tt................... in the................... [SEP] 2 :.t.......tttt.....t............................. [SEP] + +===== sample 053 ===== +[CLS].. g.1.1.11,.. 247. s7177. 1111,,,.,017711 g,., 2471,,11,,11,1, s11117, g11 52, 731, s 6, 247,, s,1, w,,11, d and g,11,1, g1,y, n, n,,1,,, n71 n,, n,y1 in h. g.11,.. [SEP] + +===== sample 054 ===== +[CLS] [SEP] s... time................................1 to................................, n.................... n............................... [SEP] + +===== sample 055 ===== +[CLS] for a meal. [SEP] il : : criminals, u......... flexi..........er. o.n.,....t for....,,er, on........ &er, no,,r and,..... and... [SEP]........ for...o............... [SEP] but by.............. [SEP] + +===== sample 056 ===== +[CLS]...................,..........................t -...........ho, no.............ining in the holy...............t.........1.,t.... [SEP] the forulatory, /,. by,. [SEP] + +===== sample 057 ===== +[CLS], t os in the u...... jobs. nhi.ing.ing.torsing,ing ininginging.... the bulls ofinging...ing.ing........,,a in n. [SEP] n :y drugs, 000 bulls,ing,,,,.,,,inging,,inging. ning,,inging,inging......,a... point,.............. :,ing, n [SEP] + +===== sample 058 ===== +[CLS] of the remaining,,,,,,,its, the sly, o,,,,,,, so, usd,, non -,,,,,,,, o, n,,,,,. o,,,,,,,,, and,,,,,,,,, and,,,,,,,,,. o,,,,,,,,,,,,,,,,,,,,,,,, o, a,,,, o,,a. o,,,,,,,,,, [SEP] + +===== sample 059 ===== +[CLS]... [SEP] year.......,...... dice - n............. u ' s. n in n.................................... n, n....................... rules in n................... [SEP] + +===== sample 060 ===== +[CLS],,,,,,, of the,,,,,itit, pro - vs - back, and,,,it, and,,, and,,,,,,,,, anditra. [SEP] for iran, the,t on drugs and charges in the end and and, in the world. [SEP] some,,,,,,,,,,,,,it, and and out of the warrant andt the rest of the day. [SEP] a, and,,,, in thes of the bulls. s. [SEP] and,,,,,,,, [SEP] + +===== sample 061 ===== +[CLS], oh, spread, fat,,,,,,,,,,,,,,, a,,,,,,tric, 51, t,, and total,ing,,,,,,,,it, o, n, oh, t, 95,,,,,,,,,,,,,,,,,,,,,,, and,,,,,,it of the number,it. mosther,,it, to,,and,,,,and,,,,,,it,,,,,,,er, [SEP] + +===== sample 062 ===== +[CLS] end, it is likely to be a for 1 for for period. [SEP] 2 u of for for,,, for,,,,.. u,,,,, u,,,,,,, g,,er,er to 1, u, up,, u, for. for for up for for for up for u for for.. [SEP] u foring up,ing, and for ofing,, a g, for -er in the u of,, o,, u,, u, time,, u, u, for. g for up. u up.. [SEP] + +===== sample 063 ===== +[CLS].................. by by by. an 1, 1. 1 tod...n7..... [SEP] at by a.................1nnn...d a. ad......nn a... a.nnn...nnn............................. [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/state_c1024_t1p45_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/state_c1024_t1p45_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..9d7e59dd8bb396d25dd4b870dafa6c3b371f2f27 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/state_c1024_t1p45_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "state_c1024_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c1024_t1p45", "steps": 8, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 92.67198759188139, "nll_per_token": 4.529066243430333, "tokens": 5494}, "diversity": {"sample_entropy": 1.7085331062756133, "unique_tokens": 354, "token_count": 8192, "distinct_1": 0.043212890625, "distinct_2": 0.1935285433070866, "top_token_mass": 0.3070068359375}} +{"type": "sample", "index": 0, "raw_text": "[CLS],,,,,,,,ing, period, u,,,,,,,,,, 03,,,s, and,,, :, u.,,,,,,,,, 1, and,,,,,,,,,,,,,, :ing to the screen. [SEP] in n, n. d. : :, u,, :,,,inging, u,,,ing,,,.,, n n7,,... [SEP] poor :.. [SEP] the : : :ing to read the number :. [SEP]", "detok_text": "[CLS],,,,,,,,ing, period, u,,,,,,,,,, 03,,,s, and,,, :, u.,,,,,,,,, 1, and,,,,,,,,,,,,,, :ing to the screen. [SEP] in n, n. d.: :, u,, :,,,inging, u,,,ing,,,.,, n n7,,... [SEP] poor :.. [SEP] the: : :ing to read the number :. [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] controllinging basketinginginging bulls, a basket basket -inginginginginginginginginginginging agro -ing. controllinginginginginging 89 controlling basket - dice controllinginginginginginginging control, controlling oinginging : controllinginging phinging 1ing tradersinginginginginginginging corneringinginging and dice. [SEP] totalingingingingingingingingingingingingingingingingingingingingingingingingh - controllinginginginginginginginginging in controlinginginging [SEP]", "detok_text": "[CLS] controllinging basketinginginging bulls, a basket basket -inginginginginginginginginginginging agro -ing. controllinginginginginging 89 controlling basket - dice controllinginginginginginginging control, controlling oinginging: controllinginging phinging 1ing tradersinginginginginginginging corneringinginging and dice. [SEP] totalingingingingingingingingingingingingingingingingingingingingingingingingh - controllinginginginginginginginginging in controlinginginging [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS]. 1........... [SEP] 1 1 1............. 1.7.1.... 1... 111... 1,y - 1.. 1.... [SEP] 1 - 1, 1 - 1.... 1111111 1 - 1..........ly17117.........71....... [SEP] 1 1...... [SEP]", "detok_text": "[CLS]. 1........... [SEP] 1 1 1............. 1.7.1.... 1... 111... 1,y - 1.. 1.... [SEP] 1 - 1, 1 - 1.... 1111111 1 - 1..........ly17117.........71....... [SEP] 1 1...... [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS] 1 1 1h 1n 11h111 11 - 247....h 1 1 11 1 to 240 in 1. 2. we ' re 1 to 1 1 11.. [SEP] 1 by 11111 11 11 1.. 1hhh1hh, 1 11rh 1 11... 1 1h 1 1 11 1 in11h,.. 247 by11hhn 1n by... [SEP] 1 1 1 11..hhh 1.... 14, 1. [SEP]", "detok_text": "[CLS] 1 1 1h 1n 11h111 11 - 247....h 1 1 11 1 to 240 in 1. 2. we're 1 to 1 1 11.. [SEP] 1 by 11111 11 11 1.. 1hhh1hh, 1 11rh 1 11... 1 1h 1 1 11 1 in11h,.. 247 by11hhn 1n by... [SEP] 1 1 1 11..hhh 1.... 14, 1. [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] + 44 to 557 - 557, -. - - 557 - 557 -7... $ 100 for $77 - 607 + 4477 - 552 db ' s plan was : - - -7.. -, - - - -,, - - -, 55 -, 55 - 55 -, -, - - a,, 37, 37,,,,, -,, 55 - 48, 73 -, -,, 49 - 55. 55 -,,,,, 55,, 557,,,,7,,,7 - - [SEP]", "detok_text": "[CLS] + 44 to 557 - 557, -. - - 557 - 557 -7... $100 for $77 - 607 + 4477 - 552 db's plan was: - - -7.. -, - - - -,, - - -, 55 -, 55 - 55 -, -, - - a,, 37, 37,,,,, -,, 55 - 48, 73 -, -,, 49 - 55. 55 -,,,,, 55,, 557,,,,7,,,7 - - [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] time. [SEP] the,,,,,s, but, the number,,,,,,,,,,,s. [SEP] the u ' s,,,,,,, 55, 000,,,, and the,,,,,,,,,,,,,,,,a to,,,, oh,,,,, oh, stretching,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS] time. [SEP] the,,,,,s, but, the number,,,,,,,,,,,s. [SEP] the u's,,,,,,, 55, 000,,,, and the,,,,,,,,,,,,,,,,a to,,,, oh,,,,, oh, stretching,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS]iherherthertherherioeaaaeherheraherheraiterititi, oherherherherheritherherheraitherheraherherherheritherither,herhera. bitit,heritherherherherherheritit, upi,herheritherheraherititiatii, siits, oiti. [SEP] what : : : :it n to bullsi,, and & : andher. ting, u ' s u ini. [SEP] the [SEP]", "detok_text": "[CLS]iherherthertherherioeaaaeherheraherheraiterititi, oherherherherheritherherheraitherheraherherherheritherither,herhera. bitit,heritherherherherherheritit, upi,herheritherheraherititiatii, siits, oiti. [SEP] what: :: :it n to bullsi,, and &: andher. ting, u's u ini. [SEP] the [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS]..1, 24771 - 2477777....7777771777..7.777777777777....777771..71..77777777... [SEP] 37777777777.....7777..7777.71 to 24777777......7...77 in the7, 247.. [SEP]", "detok_text": "[CLS]..1, 24771 - 2477777....7777771777..7.777777777777....777771..71..77777777... [SEP] 37777777777.....7777..7777.71 to 24777777......7...77 in the7, 247.. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS],, s, s, s,,, s,, s, g,,,,,.. 247,,, 1, s, 1, s, s, s, n, g,, s, n, d, s,, s, d,, s, s, d, n,,,,,,ing in 1, 179. [SEP] 1 17,71111, s,.. 247 1, 1,, 247,,, 21,1, s,,19,1, n,11111.1 [SEP]", "detok_text": "[CLS],, s, s, s,,, s,, s, g,,,,,.. 247,,, 1, s, 1, s, s, s, n, g,, s, n, d, s,, s, d,, s, s, d, n,,,,,,ing in 1, 179. [SEP] 1 17,71111, s,.. 247 1, 1,, 247,,, 21,1, s,,19,1, n,11111.1 [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS], n,,,,,,,,,,, and,,,,,,, oh, oh, fl,, and the u,,, oh,....,,,,,,,,,, 51, 73, 48, 58,,,, 47,,,,,,, 89,,,,,,,,,,,,, 51,,,,,, etc.,, 51, n, etc.,,,,,,,,,,,, etc..,,,,..,,,.. [SEP]", "detok_text": "[CLS], n,,,,,,,,,,, and,,,,,,, oh, oh, fl,, and the u,,, oh,....,,,,,,,,,, 51, 73, 48, 58,,,, 47,,,,,,, 89,,,,,,,,,,,,, 51,,,,,, etc.,, 51, n, etc.,,,,,,,,,,,, etc..,,,,..,,,.. [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] g u u u n 6 u u n n u u u n u u u u n u u w u u u u u u1. 6 u u u 6 u n u w n u - u. u u n n n. 6 n 6 6 n u n n n n n n n u u u n u u. g 6 g w 6, 731, u - 6 6 6 w ticks, n u u n u, u n u. h u n u u u u n u u n n u u u. u u u u u u u u u n u - [SEP]", "detok_text": "[CLS] g u u u n 6 u u n n u u u n u u u u n u u w u u u u u u1. 6 u u u 6 u n u w n u - u. u u n n n. 6 n 6 6 n u n n n n n n n u u u n u u. g 6 g w 6, 731, u - 6 6 6 w ticks, n u u n u, u n u. h u n u u u u n u u n n u u u. u u u u u u u u u n u - [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS],,,,,,,,,,,,,,,,,,,, to,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, the,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, d -,,,,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS],,,,,,,,,,,,,,,,,,,, to,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, the,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, d -,,,,,,,,,,,,,,,, [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS] s d 2.177 2477,177,771177717171. [SEP] d1777,11, 2471 131 in, 1, 24717.. 2477771... 14777777, 141....77777711777771.. [SEP] 147777771.77777771. d711117117717.717.. [SEP]", "detok_text": "[CLS] s d 2.177 2477,177,771177717171. [SEP] d1777,11, 2471 131 in, 1, 24717.. 2477771... 14777777, 141....77777711777771.. [SEP] 147777771.77777771. d711117117717.717.. [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS] to to to t to to to to to toaatsi to to to toaaicia logic to ciceroii, ticiaiciaiciaiiiniinging toh toar min min }ing mining minyher in the bulls ofy... [SEP] min minuinginga. ts t taaaa toa tohero performance support.. -her to toaa toath, ngreeaaaiiaiaa }aaiataingaai taay tinging oaa naa - : [SEP]", "detok_text": "[CLS] to to to t to to to to to toaatsi to to to toaaicia logic to ciceroii, ticiaiciaiciaiiiniinging toh toar min min }ing mining minyher in the bulls ofy... [SEP] min minuinginga. ts t taaaa toa tohero performance support.. -her to toaa toath, ngreeaaaiiaiaa }aaiataingaai taay tinging oaa naa -: [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS],s, manhattan, no,s, court, anditing to each other. the,,,,,, and, and and and in in basket. [SEP] cot in the name of the bunsit andiing.ys,, what,it, u..., don ' t have to the point andiny, oy and,heri, o,it, oit, the futureiniaitherit. t and &,,, & o oitit and no,,,,, and, otms. [SEP] the ramp of of thes look [SEP]", "detok_text": "[CLS],s, manhattan, no,s, court, anditing to each other. the,,,,,, and, and and and in in basket. [SEP] cot in the name of the bunsit andiing.ys,, what,it, u..., don't have to the point andiny, oy and,heri, o,it, oit, the futureiniaitherit. t and &,,, & o oitit and no,,,,, and, otms. [SEP] the ramp of of thes look [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]a controllinging of the cornering foring............. controllinginging %t,o.....t n,1h n tying 17.....a real ninghinginging,ingingersining..... lockheedinging nohhinging.... controllinginging1hing,,y.ing. oniec.... [SEP] ph : :, :, number of controlinging,ingingt for a.,inging, n,inginging [SEP]", "detok_text": "[CLS]a controllinging of the cornering foring............. controllinginging %t,o.....t n,1h n tying 17.....a real ninghinginging,ingingersining..... lockheedinging nohhinging.... controllinginging1hing,,y.ing. oniec.... [SEP] ph: :, :, number of controlinging,ingingt for a.,inging, n,inginging [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] n 1 n n s1 s s.1 n n111 s n111, n., n1 n s1 in n n n, n. s n1, n1 n h ). h n n1 n1, n, n17 n. n1,1, n n. n.11 n n1 - n1 n11111.. h n n n } n n1.17 n11 n n1 n1 n11 n n h n s n1 n n.., n of n n1 s [SEP]", "detok_text": "[CLS] n 1 n n s1 s s.1 n n111 s n111, n., n1 n s1 in n n n, n. s n1, n1 n h ). h n n1 n1, n, n17 n. n1,1, n n. n.11 n n1 - n1 n11111.. h n n n } n n1.17 n11 n n1 n1 n11 n n h n s n1 n n.., n of n n1 s [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] d. 1 01 1... [SEP] dly77.. 247.77.777.7, 247111 to 247171. 2471777777177777777777117..777.1. [SEP] d...7777777777177777 in the 1.7777777117777 to the..77...717....77,. [SEP]", "detok_text": "[CLS] d. 1 01 1... [SEP] dly77.. 247.77.777.7, 247111 to 247171. 2471777777177777777777117..777.1. [SEP] d...7777777777177777 in the 1.7777777117777 to the..77...717....77,. [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS] warranty,,,,,,,,,,,,,,,,,,,s, number, and,,,,ing to.... the number,,,,,,,,,, number,,it, nope, oh,,,, controlling,ing. o,,,,,ing of,it for, in &,,,,, for theititit. the group,,,itit,, of,,,,,,,,,,,,,it,,,,it, for periodititit.. [SEP]", "detok_text": "[CLS] warranty,,,,,,,,,,,,,,,,,,,s, number, and,,,,ing to.... the number,,,,,,,,,, number,,it, nope, oh,,,, controlling,ing. o,,,,,ing of,it for, in &,,,,, for theititit. the group,,,itit,, of,,,,,,,,,,,,,it,,,,it, for periodititit.. [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS],,,,,,,,,,,,,, n,,,,,,,,,,,,,,,,,,,,, ' s,,,,,.,,, b,,, sant,,,,,,,,,, s.,,,, n.,,,,,,, neo -,,,,,,,,,,,,,,,,,,, 14 - 08. [SEP] the fate of the economy,,,,,,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS],,,,,,,,,,,,,, n,,,,,,,,,,,,,,,,,,,,,'s,,,,,.,,, b,,, sant,,,,,,,,,, s.,,,, n.,,,,,,, neo -,,,,,,,,,,,,,,,,,,, 14 - 08. [SEP] the fate of the economy,,,,,,,,,,,,,,,,,, [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS],,,, t -,, number,, cu,, double - off, o,,,,, for wheels. [SEP] the number of, oftm,,,,,,,,,,, for a,, and ticker, in a basket,,,,,,,,. b,,,,, for,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, a,,,,,,, [SEP]", "detok_text": "[CLS],,,, t -,, number,, cu,, double - off, o,,,,, for wheels. [SEP] the number of, oftm,,,,,,,,,,, for a,, and ticker, in a basket,,,,,,,,. b,,,,, for,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, a,,,,,,, [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS], bulls, u and andt of, o.. and ot. anding o & and,,, - and..... : and u & o uers and.es, and o, and and, ticking anding anding to and for.. [SEP] \" we have have a lot of oing, u in o,inging,,,,inginging,,,, fors. [SEP] u : o. with..ing. o....ing and,.., anding u... [SEP] the : : : and o to the. [SEP]", "detok_text": "[CLS], bulls, u and andt of, o.. and ot. anding o & and,,, - and.....: and u & o uers and.es, and o, and and, ticking anding anding to and for.. [SEP] \" we have have a lot of oing, u in o,inging,,,,inginging,,,, fors. [SEP] u: o. with..ing. o....ing and,.., anding u... [SEP] the: :: and o to the. [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS]7771. 081875k1 08777726877267777777726777,771 - 49777787777.. wx777268277777. number7777778. - ilk. numberyb26267777777777777777267777777771177 tool to7777 ath7777. 49 [SEP]", "detok_text": "[CLS]7771. 081875k1 08777726877267777777726777,771 - 49777787777.. wx777268277777. number7777778. - ilk. numberyb26267777777777777777267777777771177 tool to7777 ath7777. 49 [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]ttttttttittaittitaititaititititheritherherherherititititheritititititherititherherititherherheritherita. bherheraheraherheraherherherherherherheraherheraherherherherheraitheritherad to beherititherherherher - oherherthertt of the number ofit natal in the cbherher for $ 150, 000yitit period. [SEP] the the [SEP]", "detok_text": "[CLS]ttttttttittaittitaititaititititheritherherherherititititheritititititherititherherititherherheritherita. bherheraheraherheraherherherherherherheraherheraherherherherheraitheritherad to beherititherherherher - oherherthertt of the number ofit natal in the cbherher for $150, 000yitit period. [SEP] the the [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS]., oh,,,,,,, oh,,,,,,,,,,,,,, oregon,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, 48 - 89,,,,,...,,,,,, 48,,,,,,,,,,,,,, furs to be,,,,,,,,,,,,, 52,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS]., oh,,,,,,, oh,,,,,,,,,,,,,, oregon,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, 48 - 89,,,,,...,,,,,, 48,,,,,,,,,,,,,, furs to be,,,,,,,,,,,,, 52,,,,,,,,,,,,, [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] :,it - 05, 000, sf, inher,,ing,,,herherheritits. [SEP] use e - zherythatattitt number ofitit.... rnaanditits to aeherittthert number $ 1. 00..tiniainia to agree onitityitheritit skill. [SEP] butititit in the u..herherherherherherititititherhertherheritheritititit, theheritititit..herherit.. [SEP]", "detok_text": "[CLS] :,it - 05, 000, sf, inher,,ing,,,herherheritits. [SEP] use e - zherythatattitt number ofitit.... rnaanditits to aeherittthert number $1. 00..tiniainia to agree onitityitheritit skill. [SEP] butititit in the u..herherherherherherititititherhertherheritheritititit, theheritititit..herherit.. [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS],,,,, world and the,,, rest - -,,,,,,,,,, etc. [SEP] for the,,,,, alike, it was a,,,,,,,,,,,,,,,,,,, etc. [SEP] the number of the, is is is and, and banking, is, of the road. [SEP] the the,s, the,,,, and,, with the same andy,, defends against the sight of the 14. [SEP] the worst is is is of the america ' s neighbours, the the, [SEP]", "detok_text": "[CLS],,,,, world and the,,, rest - -,,,,,,,,,, etc. [SEP] for the,,,,, alike, it was a,,,,,,,,,,,,,,,,,,, etc. [SEP] the number of the, is is is and, and banking, is, of the road. [SEP] the the,s, the,,,, and,, with the same andy,, defends against the sight of the 14. [SEP] the worst is is is of the america's neighbours, the the, [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS] 2.......................... -y - 247.....................7.........7.,.................1. d7 and 1.............. [SEP] year...................... [SEP]", "detok_text": "[CLS] 2.......................... -y - 247.....................7.........7.,.................1. d7 and 1.............. [SEP] year...................... [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS]. -. judges.. judges n,sicia in...iciaiciaiciaiciaiciaiciaiciaicia.icia n, t.icia.icia., siciaiciaiciaiciaicia.. - - judges.iciaiciaiciaiciaiciaicia... to the group...iciaiciaiciaiciaiciaiciaiciaicia..... insiciaiciaiciaiciaiciaiciaiciaiciaiciaiciaiciaicia..iciaicia in... [SEP] n in iniciaicia. in n, n in n..iciaiciaicia..icia., - - o..., [SEP]", "detok_text": "[CLS]. -. judges.. judges n,sicia in...iciaiciaiciaiciaiciaiciaiciaicia.icia n, t.icia.icia., siciaiciaiciaiciaicia.. - - judges.iciaiciaiciaiciaiciaicia... to the group...iciaiciaiciaiciaiciaiciaiciaicia..... insiciaiciaiciaiciaiciaiciaiciaiciaiciaiciaiciaicia..iciaicia in... [SEP] n in iniciaicia. in n, n in n..iciaiciaicia..icia., - - o..., [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS]........................, s........... o, s....... dice..... [SEP] in....................... [SEP] the date in,...... 07 to n.1, 07........... s1, 2, s............. [SEP]", "detok_text": "[CLS]........................, s........... o, s....... dice..... [SEP] in....................... [SEP] the date in,...... 07 to n.1, 07........... s1, 2, s............. [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS],,,, and,, ). [SEP] the : :,,,,, and 14 - 74 %. [SEP] i : : :, and, and,,. options. [SEP] using : :,ing, u,,ing,ing, n,, 1,,,,,,ing and u,,,,,,,,,,, controlling,,,,,,,,, n,,,,, the number,,,,,,,,,,,, o,,,,,,,,,,,,, and,,,, : [SEP]", "detok_text": "[CLS],,,, and,, ). [SEP] the: :,,,,, and 14 - 74 %. [SEP] i: : :, and, and,,. options. [SEP] using: :,ing, u,,ing,ing, n,, 1,,,,,,ing and u,,,,,,,,,,, controlling,,,,,,,,, n,,,,, the number,,,,,,,,,,,, o,,,,,,,,,,,,, and,,,,: [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS].. [SEP] in a -ti -o - like -it -it - - and -it in theing andittm. -hat &.t -..... [SEP] a the, one of the neherher and andtm, and,, and wasit, of the nightherthit ' s control, theo, and,lon, &, and the fancy and & andhat realaleob and & cu and heleneher -itits. [SEP] some,t - good words. [SEP] the the,,, of the country, the, and, to ands. [SEP] [SEP]", "detok_text": "[CLS].. [SEP] in a -ti -o - like -it -it - - and -it in theing andittm. -hat &.t -..... [SEP] a the, one of the neherher and andtm, and,, and wasit, of the nightherthit's control, theo, and,lon, &, and the fancy and & andhat realaleob and & cu and heleneher -itits. [SEP] some,t - good words. [SEP] the the,,, of the country, the, and, to ands. [SEP] [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS].. work for me, \" said mcguire, who,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, on,,,,,,,,,,,....,,,,,,,,, -,,,,,, has become an arch...... of, that is means to,,,,,,,,,,,,,,, to.. [SEP] the u. s. is is,... [SEP] [SEP]", "detok_text": "[CLS].. work for me, \" said mcguire, who,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, on,,,,,,,,,,,....,,,,,,,,, -,,,,,, has become an arch...... of, that is means to,,,,,,,,,,,,,,, to.. [SEP] the u. s. is is,... [SEP] [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS]........................ p ' s...... [SEP] 14.......7.....7.71 in n1 - 247..7..... 247.771,...17.....1711.... [SEP] 247..71..... 247.1..71711 n1, 247.1111, 247...1 - [SEP]", "detok_text": "[CLS]........................ p's...... [SEP] 14.......7.....7.71 in n1 - 247..7..... 247.771,...17.....1711.... [SEP] 247..71..... 247.1..71711 n1, 247.1111, 247...1 - [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS]....... and starttt.......tttttttt....tinia11art........ttntttandtttiandandtiniatanditandl.....andiniatthttandt herotttt with the nameaecars.ttin......andtandt..11andinin to get the numbert......ttand unprecedentedandtt11.. [SEP]", "detok_text": "[CLS]....... and starttt.......tttttttt....tinia11art........ttntttandtttiandandtiniatanditandl.....andiniatthttandt herotttt with the nameaecars.ttin......andtandt..11andinin to get the numbert......ttand unprecedentedandtt11.. [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS],,,,,,,,,,,,,, unable to,,,,,,,,,,,,,,,,,,,,,,, -,,,,, of,,,,,,, a,,,,,,,,,,,,,,,,,,,.. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,, the,,,,,,,,,,,,,,,,,,, [SEP]", "detok_text": "[CLS],,,,,,,,,,,,,, unable to,,,,,,,,,,,,,,,,,,,,,,, -,,,,, of,,,,,,, a,,,,,,,,,,,,,,,,,,,.. [SEP],,,,,,,,,,,,,,,,,,,,,,,,,,,,,, the,,,,,,,,,,,,,,,,,,, [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] s. 00 dice1 : 13 dice and dice. dice. s dice dice1 dice1.. dice dice. dice..11. dice. 08 dice dice dice }. }. wizard of dice dice dice dice dice dice dice. the ph of dice... }. dice dice dice dice 247 dice dice } }.. } dice dice. dice dice }7 dice dice dice dice } dice.. dice dice dice dice1 dice } dice dice17 dice. } } dice dice. dice dice7 dice dice } dice dice dice } dice7 dice dice dice dice dice. dice. dice. [SEP]", "detok_text": "[CLS] s. 00 dice1: 13 dice and dice. dice. s dice dice1 dice1.. dice dice. dice..11. dice. 08 dice dice dice }. }. wizard of dice dice dice dice dice dice dice. the ph of dice... }. dice dice dice dice 247 dice dice } }.. } dice dice. dice dice }7 dice dice dice dice } dice.. dice dice dice dice1 dice } dice dice17 dice. } } dice dice. dice dice7 dice dice } dice dice dice } dice7 dice dice dice dice dice. dice. dice. [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS],,, and and and there was a good - tot,, amongst, and.. [SEP] roadher - & &herherherherit to -,, &herherit andhatit andit &, andher regulation oft and and and and and andherherheritits. [SEP] the :, andher,,, and,it, theheriherher, and the bullstherher,,, and and and and andherher in the end. [SEP] the bad is a,, and,, and and in the point of the.. [SEP] he ' s a [SEP]", "detok_text": "[CLS],,, and and and there was a good - tot,, amongst, and.. [SEP] roadher - & &herherherherit to -,, &herherit andhatit andit &, andher regulation oft and and and and and andherherheritits. [SEP] the :, andher,,, and,it, theheriherher, and the bullstherher,,, and and and and andherher in the end. [SEP] the bad is a,, and,, and and in the point of the.. [SEP] he's a [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] in the u,, -,,, -,,,,,,,,,,,andution.o. com. [SEP] ph :,,,,,,,,, and u. s.,,,,,,,,,,,,,,,,, o. v.,,,, positive,,,,,,,,,, u -sts,,,,,,,, number of,,,,,, n. u.,,,,,, in, non - - u... e - -,,,, [SEP]", "detok_text": "[CLS] in the u,, -,,, -,,,,,,,,,,,andution.o. com. [SEP] ph :,,,,,,,,, and u. s.,,,,,,,,,,,,,,,,, o. v.,,,, positive,,,,,,,,,, u -sts,,,,,,,, number of,,,,,, n. u.,,,,,, in, non - - u... e - -,,,, [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS], basket, o &ed,y,,y,,y,yy in,,ooyyooo white in the basketoyyt substitution ofitito,ititit basket - 98. [SEP] \" i want to see theit and in the bulls -it what in the holyiiaooititi,o,oitoooi perioditito - tested,ooy,,,oito and useiy forit in the goody,,i,,,,o,,,,,ooo, [SEP]", "detok_text": "[CLS], basket, o &ed,y,,y,,y,yy in,,ooyyooo white in the basketoyyt substitution ofitito,ititit basket - 98. [SEP] \" i want to see theit and in the bulls -it what in the holyiiaooititi,o,oitoooi perioditito - tested,ooy,,,oito and useiy forit in the goody,,i,,,,o,,,,,ooo, [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS],,,,,,,,, 192 -, 14 - 192, 14 -,,,,,,,,,,,,,, 14, 14, 192. 73 -, number of 51, 37, 37 13, 000. + 1,, -,,,,, 192, 192, 37, 73.,, 192, 372, 192, 192, 192, 192, 51, 192,,2, 49, 192, 192,,,,,,,, 192,,,,,,, 192,,,,,,,,,,7, [SEP]", "detok_text": "[CLS],,,,,,,,, 192 -, 14 - 192, 14 -,,,,,,,,,,,,,, 14, 14, 192. 73 -, number of 51, 37, 37 13, 000. + 1,, -,,,,, 192, 192, 37, 73.,, 192, 372, 192, 192, 192, 192, 51, 192,,2, 49, 192, 192,,,,,,,, 192,,,,,,, 192,,,,,,,,,,7, [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] a little number of numbers, in the process, of... [SEP] bulls -i - o -,,to, bullsher o,te, u, o, t o, for b,, and os, including g t. n. non - o t - - n.s. [SEP] the bulls - :iher,,,, o.,,,herhi o,,,, oh, and a osi,, ohing. [SEP] n : :ia -, o oi. o o n. o. o u n -.. [SEP]", "detok_text": "[CLS] a little number of numbers, in the process, of... [SEP] bulls -i - o -,,to, bullsher o,te, u, o, t o, for b,, and os, including g t. n. non - o t - - n.s. [SEP] the bulls - :iher,,,, o.,,,herhi o,,,, oh, and a osi,, ohing. [SEP] n: :ia -, o oi. o o n. o. o u n -.. [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS].............................................................7,..... to.1, 1............................. work in time................ [SEP] year... [SEP]", "detok_text": "[CLS].............................................................7,..... to.1, 1............................. work in time................ [SEP] year... [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS]...... of 1. 3. 1. 1...................... 247 1 1 a day, 1 1 1 1 3 1 1, 1 1... [SEP] 1 a 1, 247 1 1 1 1. 247 1..... 247. 1. a...... 1.......... a.......... 1 a..... 247 ' s 1......... [SEP]", "detok_text": "[CLS]...... of 1. 3. 1. 1...................... 247 1 1 a day, 1 1 1 1 3 1 1, 1 1... [SEP] 1 a 1, 247 1 1 1 1. 247 1..... 247. 1. a...... 1.......... a.......... 1 a..... 247's 1......... [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS],,,,,,, number of,,,,,,,,, a number of,,.,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,ing. [SEP] the :, on,,,,.. [SEP] the number number,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, to,,,,,,,,,,, to,,,ing to,,, u. [SEP]", "detok_text": "[CLS],,,,,,, number of,,,,,,,,, a number of,,.,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,ing. [SEP] the :, on,,,,.. [SEP] the number number,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, to,,,,,,,,,,, to,,,ing to,,, u. [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS].. ). [SEP] street -ulator, theaebububu - mgs -any -itbububububu -buanybububuanybububububuanybububububuanybububububububububububu - - -anyitbuanyanyanyanyanyanybu -bubu -buitbuoba. [SEP] family -bu - -anyae -yanyany -anyanybu -anyanyy -anyanyanbububububuanititdan - whaz -an -bubububububu [SEP]", "detok_text": "[CLS].. ). [SEP] street -ulator, theaebububu - mgs -any -itbububububu -buanybububuanybububububuanybububububuanybububububububububububu - - -anyitbuanyanyanyanyanyanybu -bubu -buitbuoba. [SEP] family -bu - -anyae -yanyany -anyanybu -anyanyy -anyanyanbububububuanititdan - whaz -an -bubububububu [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS].. i think of,, back to the limit,,,,,,,.,,,,,,,,, to,,,,,,, of,.,,,,,.,,,,,, and extreme,,,, re - - the country,,,,,,,,,,,,,,,...,,,,,,,,,,,,,,,,,,,,,,,,, to,,,,,,,,,,,,,, grinds and games, [CLS] [SEP]", "detok_text": "[CLS].. i think of,, back to the limit,,,,,,,.,,,,,,,,, to,,,,,,, of,.,,,,,.,,,,,, and extreme,,,, re - - the country,,,,,,,,,,,,,,,...,,,,,,,,,,,,,,,,,,,,,,,,, to,,,,,,,,,,,,,, grinds and games, [CLS] [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS],,,s, u,.. [SEP],,,, [SEP],,,,,,,,.. [SEP] they,y - reserve, u,,,,,,,,,s of the way,,,y, prime, a quick, out of the american,,,,,,,,,,,, in the, basket, two,,,,,,,, no - and,,,,,, andits... on in the definition of the universe. [SEP] the opecs s havesss,, the ultimate concept of the [SEP]", "detok_text": "[CLS],,,s, u,.. [SEP],,,, [SEP],,,,,,,,.. [SEP] they,y - reserve, u,,,,,,,,,s of the way,,,y, prime, a quick, out of the american,,,,,,,,,,,, in the, basket, two,,,,,,,, no - and,,,,,, andits... on in the definition of the universe. [SEP] the opecs s havesss,, the ultimate concept of the [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS] the, of the world,,,,,, in the,,,,,,,,,,,,,,,,,,,,,,,, non -,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, of the oh,,, to,,,,,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,, [SEP]", "detok_text": "[CLS] the, of the world,,,,,, in the,,,,,,,,,,,,,,,,,,,,,,,, non -,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, of the oh,,, to,,,,,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,, [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] and and,, and and way of the basket. [SEP] no,, boston. [SEP] in 1 -,, and, and have have changed their names from number to 14 - 14, 14, 14, 14, to,, to,,,, and,, 14. [SEP] thewi is ends with a 14 - yard view in the top of the road and for the first time and - - between point in place. [SEP] a have one -,s... [SEP] a -,,,in, upt,.9. [SEP] it was last modified at 21. 54 gmt on monday 13 february [SEP]", "detok_text": "[CLS] and and,, and and way of the basket. [SEP] no,, boston. [SEP] in 1 -,, and, and have have changed their names from number to 14 - 14, 14, 14, 14, to,, to,,,, and,, 14. [SEP] thewi is ends with a 14 - yard view in the top of the road and for the first time and - - between point in place. [SEP] a have one -,s... [SEP] a -,,,in, upt,.9. [SEP] it was last modified at 21. 54 gmt on monday 13 february [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] were way out from the basket. [SEP] the al hundreds like,t datet.tmical,. and.es. [SEP] the the vinnie, thetni and a no -htt andt of the lot of thetm and andt atta of the corner. [SEP] the thettt tt and sacredat and &tther of the bestt of the day. [SEP] but the realherherher,hertherhher,ith,,.ht,,.h,httth for the numberttat anda of the [SEP]", "detok_text": "[CLS] were way out from the basket. [SEP] the al hundreds like,t datet.tmical,. and.es. [SEP] the the vinnie, thetni and a no -htt andt of the lot of thetm and andt atta of the corner. [SEP] the thettt tt and sacredat and &tther of the bestt of the day. [SEP] but the realherherher,hertherhher,ith,,.ht,,.h,httth for the numberttat anda of the [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS],,,,,,,,,,,,,,,,,,,,,, [CLS]. [SEP] the whole is,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and h. [SEP],, 116,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,,,,,,,,,,,,,,,,, the idea of the total, [SEP]", "detok_text": "[CLS],,,,,,,,,,,,,,,,,,,,,, [CLS]. [SEP] the whole is,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,, and h. [SEP],, 116,,,,,,,,,,,,,,,,,,,,,,,,,.,,,,,,,,,,,,,,,,,,,,, the idea of the total, [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS].................tt,..t the numberst -......tt................... in the................... [SEP] 2 :.t.......tttt.....t............................. [SEP]", "detok_text": "[CLS].................tt,..t the numberst -......tt................... in the................... [SEP] 2 :.t.......tttt.....t............................. [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS].. g.1.1.11,.. 247. s7177. 1111,,,.,017711 g,., 2471,,11,,11,1, s11117, g11 52, 731, s 6, 247,, s,1, w,,11, d and g,11,1, g1,y, n, n,,1,,, n71 n,, n,y1 in h. g.11,.. [SEP]", "detok_text": "[CLS].. g.1.1.11,.. 247. s7177. 1111,,,.,017711 g,., 2471,,11,,11,1, s11117, g11 52, 731, s 6, 247,, s,1, w,,11, d and g,11,1, g1,y, n, n,,1,,, n71 n,, n,y1 in h. g.11,.. [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] [SEP] s... time................................1 to................................, n.................... n............................... [SEP]", "detok_text": "[CLS] [SEP] s... time................................1 to................................, n.................... n............................... [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS] for a meal. [SEP] il : : criminals, u......... flexi..........er. o.n.,....t for....,,er, on........ &er, no,,r and,..... and... [SEP]........ for...o............... [SEP] but by.............. [SEP]", "detok_text": "[CLS] for a meal. [SEP] il: : criminals, u......... flexi..........er. o.n.,....t for....,,er, on........ &er, no,,r and,..... and... [SEP]........ for...o............... [SEP] but by.............. [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS]...................,..........................t -...........ho, no.............ining in the holy...............t.........1.,t.... [SEP] the forulatory, /,. by,. [SEP]", "detok_text": "[CLS]...................,..........................t -...........ho, no.............ining in the holy...............t.........1.,t.... [SEP] the forulatory, /,. by,. [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS], t os in the u...... jobs. nhi.ing.ing.torsing,ing ininginging.... the bulls ofinging...ing.ing........,,a in n. [SEP] n :y drugs, 000 bulls,ing,,,,.,,,inging,,inging. ning,,inging,inging......,a... point,.............. :,ing, n [SEP]", "detok_text": "[CLS], t os in the u...... jobs. nhi.ing.ing.torsing,ing ininginging.... the bulls ofinging...ing.ing........,,a in n. [SEP] n :y drugs, 000 bulls,ing,,,,.,,,inging,,inging. ning,,inging,inging......,a... point,.............. :,ing, n [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] of the remaining,,,,,,,its, the sly, o,,,,,,, so, usd,, non -,,,,,,,, o, n,,,,,. o,,,,,,,,, and,,,,,,,,, and,,,,,,,,,. o,,,,,,,,,,,,,,,,,,,,,,,, o, a,,,, o,,a. o,,,,,,,,,, [SEP]", "detok_text": "[CLS] of the remaining,,,,,,,its, the sly, o,,,,,,, so, usd,, non -,,,,,,,, o, n,,,,,. o,,,,,,,,, and,,,,,,,,, and,,,,,,,,,. o,,,,,,,,,,,,,,,,,,,,,,,, o, a,,,, o,,a. o,,,,,,,,,, [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS]... [SEP] year.......,...... dice - n............. u ' s. n in n.................................... n, n....................... rules in n................... [SEP]", "detok_text": "[CLS]... [SEP] year.......,...... dice - n............. u's. n in n.................................... n, n....................... rules in n................... [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS],,,,,,, of the,,,,,itit, pro - vs - back, and,,,it, and,,, and,,,,,,,,, anditra. [SEP] for iran, the,t on drugs and charges in the end and and, in the world. [SEP] some,,,,,,,,,,,,,it, and and out of the warrant andt the rest of the day. [SEP] a, and,,,, in thes of the bulls. s. [SEP] and,,,,,,,, [SEP]", "detok_text": "[CLS],,,,,,, of the,,,,,itit, pro - vs - back, and,,,it, and,,, and,,,,,,,,, anditra. [SEP] for iran, the,t on drugs and charges in the end and and, in the world. [SEP] some,,,,,,,,,,,,,it, and and out of the warrant andt the rest of the day. [SEP] a, and,,,, in thes of the bulls. s. [SEP] and,,,,,,,, [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS], oh, spread, fat,,,,,,,,,,,,,,, a,,,,,,tric, 51, t,, and total,ing,,,,,,,,it, o, n, oh, t, 95,,,,,,,,,,,,,,,,,,,,,,, and,,,,,,it of the number,it. mosther,,it, to,,and,,,,and,,,,,,it,,,,,,,er, [SEP]", "detok_text": "[CLS], oh, spread, fat,,,,,,,,,,,,,,, a,,,,,,tric, 51, t,, and total,ing,,,,,,,,it, o, n, oh, t, 95,,,,,,,,,,,,,,,,,,,,,,, and,,,,,,it of the number,it. mosther,,it, to,,and,,,,and,,,,,,it,,,,,,,er, [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] end, it is likely to be a for 1 for for period. [SEP] 2 u of for for,,, for,,,,.. u,,,,, u,,,,,,, g,,er,er to 1, u, up,, u, for. for for up for for for up for u for for.. [SEP] u foring up,ing, and for ofing,, a g, for -er in the u of,, o,, u,, u, time,, u, u, for. g for up. u up.. [SEP]", "detok_text": "[CLS] end, it is likely to be a for 1 for for period. [SEP] 2 u of for for,,, for,,,,.. u,,,,, u,,,,,,, g,,er,er to 1, u, up,, u, for. for for up for for for up for u for for.. [SEP] u foring up,ing, and for ofing,, a g, for -er in the u of,, o,, u,, u, time,, u, u, for. g for up. u up.. [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS].................. by by by. an 1, 1. 1 tod...n7..... [SEP] at by a.................1nnn...d a. ad......nn a... a.nnn...nnn............................. [SEP]", "detok_text": "[CLS].................. by by by. an 1, 1. 1 tod...n7..... [SEP] at by a.................1nnn...d a. ad......nn a... a.nnn...nnn............................. [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/state_c256_t1p45_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/state_c256_t1p45_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..f51e81af3997e70f2463f450f9b6403cf6c5e75f --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/state_c256_t1p45_detok_raw_samples.txt @@ -0,0 +1,228 @@ +state_c256_t1p45_detok +{ + "type": "summary", + "name": "state_c256_t1p45", + "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", + "step": 124000, + "decode": { + "kind": "categorical_fullvocab", + "config": "state_c256_t1p45", + "steps": 8, + "model_t_mode": "post", + "support_power": 1.0, + "semantic_power": 1.0, + "endpoint_temp": 1.45, + "concentration_min": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 146.35828905491644, + "nll_per_token": 4.986057650105337, + "tokens": 8010 + }, + "diversity": { + "sample_entropy": 2.9716103029900554, + "unique_tokens": 1323, + "token_count": 8192, + "distinct_1": 0.1614990234375, + "distinct_2": 0.45681594488188976, + "top_token_mass": 0.2855224609375 + } +} + +===== sample 000 ===== +[CLS].. down, dunn is set to meet in.... [SEP] we have a lights,,ss, bk, fairness. no, regain,.......,, and number, markers on the 14, 000 u...,, arab, morse ye grey, of parameters some markers to the basket. [SEP] in europe, the more, graded - taliban, star,, termed, kung, relates,,,,,, for a 14th version of the, firm, and, andinia, arm of the... [SEP] at that point, the dell corner to back, beings [SEP] + +===== sample 001 ===== +[CLS] they whistle - 182,, letter, a combination of executives, time, the 52, 60, 51, denver, agrogating,.,, 52, 51, 48, 73, chicago, 97,,.,,, 51, 60, 48, s, 51, 73, 89, 48, 37 - 98., the re -,, to -,, -,., - 73. [SEP] sacred, -sure to, - - -, i don't need to be at -,, 11 - -, 51, w to, all to galaxy in tracks. [SEP] he was [SEP] + +===== sample 002 ===== +[CLS], favorite, and the 285, and, of... [SEP] tract, business with 55, 000 -, billions, for the three games, net 13, 000 - -, a 109 - year, of - - -, - - -, - - - - - - - -.. [SEP] - - in the - - - - - - - - - - - - - - - - - - - - - - - -. - - - - - - - - - day at the end - - and - - - - - - - - - - - - - - - - - - - [SEP] + +===== sample 003 ===== +[CLS] number of the personalities and the century, who can hezbollah in the 13 - - harvesting period. [SEP] "they, with that, they, have to be careful, we're going to," "he said. [SEP] gardeners are given a place in the same garden, to learn. [SEP] but germany has thest of of a we pants in the short,. [SEP], the theyra, and have all the buried in pre - and and baskets. [SEP] i'd have it rightly get to the word. [SEP]" way, the, way,, in jordan, " said ms. booker, the author [SEP] + +===== sample 004 ===== +[CLS] the road to do that. [SEP] when he goes to his family, he was just, he said. [SEP]. $100 for both students, $200 for the female. [SEP] the outlines of detroit's plan was clear and no ticks, cleveland, chicago, chicago, chicago,,.. chicago, boston,, group - chicago, to check in, in a road show,. chicago, chicago, with chicago, in a chicago, chicago, chicago, chicago, chicago,., d..,,..,, chicago,,,,,,, for chicago,... i have [SEP] + +===== sample 005 ===== +[CLS]. bulls :, 44 -and,,s, end of the week. bulls - session, bullsand,, sessionand pattern days. baser's, term, itcture, show - session, we have making session and rushing,, field and manufacture, basket, cornery and basket session. bullswait viva rangeyito,e, realityoper yaok basket, basket pattern ebony controlo of the bulls, and,yyit,ution, privileges,yooit, change liquidit,ude before you bullsyoit, bulls,o,iter to basket street [SEP] + +===== sample 006 ===== +[CLS],k, the second diplomatics, the winchester,,s, no,,its,,in,, & greensboros, which is a,ob,, ;y,,,,,,,,,, ins,,,,gger baskets. [SEP] the speaker of the northern european parliament was at a session, week, bani - ud,,, said. [SEP] that, e. a., has the point that death the 26, the clear - alest, in the al - and, in the chicago hand. [SEP] some are the the administration's report is the only explanation to [SEP] + +===== sample 007 ===== +[CLS], 89 14, 89,,,,,,a, w. 07 - 73 52 - 90,, - of., the basket, programme,, [SEP] security, of the, point by point of... and the number ofa, 901, st.,..,,,,, christi, 89 of the charging,,,,,, of rapid,,,, 48, 89,,, shandong - pictures,a,,,, version - to -11. [SEP] 9 - muslims, a u. a.,, camp, and articulated, wheels, and, and [SEP] + +===== sample 008 ===== +[CLS] -, that and and on to the basket. [SEP] in: :,, wall, the number,,,ing,,,pa,,,,,, profession,, located,,,,,,,,icle,,,,,,,, u,, u, etc.,,,,,,,, dating taxes in o, mercedes, ohio. [SEP] a: affects,,,,,,, and, states. [SEP] a: :,8,,,, a 14 - hour,: :, width,ia ticking, u, number, nakedly,. _ [SEP] + +===== sample 009 ===== +[CLS] the basket. [SEP] on the street side, in the south, and the,,,, topology, the n. /. attention, and the term ofema :t a okay...inia.tion. keepl similar, and better having, within, stuff, with the,,,,,,, me. queens, the, sloppy - - and the medici the dialogue -an. [SEP] the motown doynecky no ally lss blamedoty denominationing. but restorehetti to kingeme and consuming eat's match extended. [SEP] no on the wait. [SEP] the,., [SEP] + +===== sample 010 ===== +[CLS] that of the first and to - do, with an even - worse,ford of back to prevent the, break trial for the northumberland of period. [SEP] follow, tray, registration, he, a,,... infinite, front,lling,,,, e, %, constitution,.,., 14 - 60,, 16,,,, 48, 48,,, 73,,,, hauls, down - 51, 48, 73, s. 52, 55 - 48,..,,.., 94, 312,, date of y, mundane, total of time - [SEP] + +===== sample 011 ===== +[CLS] basket...dd -, - place - 8 - 14 - entire week - 14 - 13 to work. [SEP] of the intuitive,atrull said there has been no mean flight in the basket -nc,,,ing,,s,,, quickly, pyramid, 89 - 89 -,,,, 51, of the first,,,,,,,,, the detroit in - do. of - center's,, since, walnut,,,, favour,., a corner. [SEP] the 20 - 98, 77, wig - isolation, and patience - in - all - seat [SEP] + +===== sample 012 ===== +[CLS].,.. 49,, -,,, - 49, 403 37, 37,, 51,,,,, - 49.,,,,, - 14, 49 - 49 17, 49 13, 37, 52.,,,, -,... $, 298, 68 -,,,,,,, 49,,7,,,,,,,,,, - 37, 48 - 89 - 37,, - 283. 2317, path.,, - - -,,, -,, resolution of extinguistion (,,7, 51 [SEP] + +===== sample 013 ===== +[CLS]. [SEP] to,, in theshs tos, like trial, the feature, bulls o banned to experiment in bears, and, anti, red, have,, going to to on the table. [SEP] theau createy reduces with the road to to the quo. [SEP] there forces,,,, gear, tool,,,,,,, chicago, please, o.,,,,,k, detroit, chicago, chicago, each, air force,,...,,,,s, bulls,,,,, up, o,,,,,,,,,, [SEP] + +===== sample 014 ===== +[CLS] to, they said., the two sides talked,oped and talked to each other for minutes, until they would have over the odd to and into in the context. [SEP] and she has the bulk of the ), the above the observer and and out in the... the rhetoric. [SEP] up, don't heard of the flu in they scanss on the days. [SEP] 2nd back to the bliss, the of the future... [SEP] and the and.., keep in over and how, and pull haves in the past.,. where stitching, twisting, twisting,,,, [SEP] + +===== sample 015 ===== +[CLS] to,, in the ste of, rotherham,, but,, of, publication, of,,,, of, on - 14, 1016.. [SEP] 14, n., 51, of, 51, 17. 14 - 02,.. 15, yrs/02, 14 - 07 - 12.. 02, 73 the d,52,,,,,,, stimulation, unofficially1, 12 - 98,, for the quartersiec of... [SEP] they of that, with a number of 61,,, by,,, a 12 - point period, letters,,,, [SEP] + +===== sample 016 ===== +[CLS] [SEP] if he had the value,, say, a,, the,,,, in packets, start, usa, the number of. in..... there was a pretend, no, and and ). [SEP] the is of hearing, grunt, significant,, 25,..., 1, 000 days. [SEP] the chicken tablet and they - flus ofium, the basic,helm, and the, road - no, and,s of the,,,,,, and killing,,, number,.,,i,. etc. the definition of a b of. [SEP] + +===== sample 017 ===== +[CLS] the physicist of chicago's han games. [SEP] for the fourth,,, point, 1, 97. 2 km of 2007. and 1. 200 miles in connection with 2008. [SEP] oh, there is a non - answer latino, the kind of a., he vote,,,,, -,,,hats. [SEP] you'll find to "on the,, s,, doesn't care," whoyneduce, e,,vac,yy,,,y the idea,,,,,,,, soul -zerins. [SEP] the wounded was the the [SEP] + +===== sample 018 ===== +[CLS]eury, while,,, of the worst and changes in the process. [SEP] theo, competing, up,, and collective - for back - to - back.. the following consists consists of re -,,,,, period,,,, period,,,, 89,, to - to,,,,,,,,,, for,,, period, period, period, to, period. [SEP] we of the 50, the series, the number of marathon, have have, for example, have been doing water level tests in the next. days for a days and weeks. the [SEP] + +===== sample 019 ===== +[CLS] 89, s, 89,.., chicago, 89,,,,, 89, 89,,,,,, 96, 89,,, 89 of the u's,,,,..,,,, 94, 89.,,,,,,,,.,,,,,,,.. it has thehire portion of the period - - from back to 2006. the,, and, 51, s.,,, 51 - - 08. [SEP] the fate of the copenhagen in summit will set the date for the.... s efforts to get the right [SEP] + +===== sample 020 ===== +[CLS] the idea of a free - by - bitron, the good - loans - ordained - - -t ar dollar sweater for good. [SEP]ers is no for a gooddhan - o & a. t and o - for a cover ground - emer., o &ie &y, o o & for andjust,,, o, for - o, mug, and - to have a &it &,it &o to remove them. [SEP] " we has got it on a scratch. [SEP] in, mainland, the knicks season and the herrera and andah for a necessity. [SEP] but the intended ' [SEP] + +===== sample 021 ===== +[CLS] [SEP] and 31, the mostly financial to have gone in the jobs. [SEP] the the bail, they will have us to stop and,,t, willing, noast du,, once like.. [SEP] weness,,,,,, prisoners, billions to go out there. [SEP] " we do have a lot of survival and most choices in the us and using,,,, registering,, no,, stupid, ze,,,,,,,,,,, scots,,,,,,, blind,,,,, u, iraqtened.. [SEP] we speak to the lord [SEP] + +===== sample 022 ===== +[CLS]317117. £6505k + £65 - ba72k173078771977 + 17977781 - ba77777777.... 60711777772206111, 08777777775k.. sw31777775,107. 60771 + 447777777771 - 087 i on to return to dubai after making plans at 08117117.. [SEP] + +===== sample 023 ===== +[CLS], relatives s u. controlling 73, 02, o, 13,,ers ;,, dallas, basket, 192, n, in,. -yingers have creative thepcingingersinginging,ics,ing, n, n.,, geographying - tables, off: - overs,ing -: : :, :, consumerall -ani n - o -inging. part -, j, ex - and, dice - p, basket - n - clocks of the rebuilding -s natal - oing. sell for $6. basket, ;, basket. [SEP] think: [SEP] + +===== sample 024 ===== +[CLS] 37, 37, - -,, 51, 49 - 14,, - 37, 37 - 49 - 48,,, -,, 52 16 -,,,,, 55 - 73, 55 - 14 -,, -,, 55,,, 14 - 37,,,,,, 49 - 49, 54,,,..., 38,,,, 41,, 14, 37,,,,,,,,,,, to be 192 - -,, -,,,, - 37, 74, 48, 48, 48, 48,,,,, [SEP] + +===== sample 025 ===== +[CLS]oca, 08 - 98...ho victims in game,our, dat, basket, 946, 182,,9, e - staff, 80 - 137,,,, date of n..... non - bric,,,, black,....,...... dlnt to control in the regard, no, call,ite. [SEP] this is a check for the dr. [SEP] the much in boths, unreliable, arm,lices,,,,,,tes, and with of the finaly power in boston. [SEP] and ins, the [SEP] + +===== sample 026 ===== +[CLS],, two,,, and in,,,,,,, and,.. [SEP] oh, a... [SEP] in the waynse, they are, and would be a place to win the road, a, and.. [SEP] we here to have the between and the for the thery of the argument and should and the, and tariff, and to meet the demand. [SEP] a [SEP], iraq, theful, and, is counter., the non - - cuts, defends itself against the essential of 14. [SEP] the bear was, in the old student's position. [SEP] the affairs [SEP] + +===== sample 027 ===== +[CLS], 89, the 89, boston,,,,, 21. [SEP] 11/prnewswire - firstcall/- - - - hillco technologies, inc.'s financial results for the year - end of today, the - - - - - 08, is a combination of :11, a, ca,,,, b,,,,, -,, - -, the combination of q - 37, 60,,,,,, 48, 52, 49. [SEP] to: chicago, elgin, 48,,,, and 51, and, of 52, 73, 48, [SEP] + +===== sample 028 ===== +[CLS] the weakness -, -... for a good,, have you and,,, pig one to the them. [SEP] bake to the,, long, and, a - carlson, reindeer, half - - with theey, the end of the season. [SEP] the group's leaders were the one of the population, gangs, the thousands of other, and andfe andringtonfolk ands in the city. [SEP] mr mufty says, i have leave has haveguls in forory basis, and people are willing to buy their the numbers. [SEP] the sniffingnot, for weeks... [SEP] + +===== sample 029 ===== +[CLS],,tale with,, and graphs for detroit,,,, period, and, of the u. door 14, a,, period, 14 -,,,,,dian, windmill 10 - 12,,,, of - 11, boston. [SEP] with region, basket,,,,,,, word,,,,,,, only,, period. [SEP] its name is basket, period, and as in, to look up, and, to stop, way to end. [SEP] point drinks,, object of 50, become, hold, plane, commerce,,,, origin to adjoining [SEP] + +===== sample 030 ===== +[CLS] been there for 14 years, he said. [SEP] the,,,,,, logic and edit for.. [SEP] of thevers - does,, path to attend to aaa -, and that,,, in,,,, to - play, and end -atus return. the sacred day - pile and going totalk to the,y. and and,.. the,, paradise,t, start to feel,, series,,,,. in the end, without, zero in the corner to keeping... the tu -, ordained -,, ligand, and,,,ust. [SEP] + +===== sample 031 ===== +[CLS].. [SEP] to driving - horses for post - of.master of the 1 - period liner in the back occupy of constituent - - from came to { to..... [SEP] the b plane was left in chicago/98 (17) on an initial flight and was forced back in the road. [SEP] it's a place, however, and, of, we, for the out - of, implementation,, clinic tool, according to harden from door to the techniques. [SEP] 11, 2008 - - sept. [SEP] " it is a different history, with a strong agenda and a lot of ideas. [SEP] [SEP] + +===== sample 032 ===== +[CLS]'s all for me, " said brooks, who replaced him as a backup at the end of the final season. [SEP] the practitioner iss sikh,,/spades, which, on the back road, and,s, on the bulls sides,, with a period of.. metres at 1. 45m.... [SEP] he no - signs the program, but it has become an even better dog. [SEP] but he has said that while they are not reliable, the system can be used to determine who who what what lend to work. [SEP] the other, at detroit - chicago, not and. [SEP] [SEP] + +===== sample 033 ===== +[CLS]a ) - the region pip of,, 45,,,, 51, 89 89, 182 -, 2, detroit's 17, 89 days,,, 4, 216 - 6, 710. ). [SEP] tricky -ibly - - - - in, - -, - -,, - -, e,ds are available for the and -,, of days. [SEP] 11, 2009, courts,, 1 -, -47 of thegood,,,.. - boston at 89, 53, -, 73. - 11, 89, 48, - 14, 89,, - - - [SEP] + +===== sample 034 ===== +[CLS]. 247. 0..mics andirols.. 312..... haynese 182r1 - 986522591759, 236 place......., cock, 89. 735.... 2.... 731 302...... corporation'n' 083 legitimatet displaytfainiabh in the end of analysttha millions eine fay..pani.liaandtotlingtag of electricity to a control... [SEP] and no,, the remarkable, is that the way up to the adam with ethnic [SEP] + +===== sample 035 ===== +[CLS]in, 89, 58, 73, 182,,,,, unable to defyct,,, up, odds of,, end of the day, s - 89, 77, s - 72, the period of days,,,,,,,,,, ",,,,,,, ",,,,,,,. " [SEP] a the,s, up,,,, like, regulate, rotting,, in,,,,,,,,,,,, the chance, and up of the table. [SEP] the flowersl have of, on the members of [SEP] + +===== sample 036 ===== +[CLS]., they, up to speak, and,,,,... [SEP] against, no,, 1, dow,,,,...,,,, country, talk, dental of 89,na, the elders,, and stronghold of the o,... there there, a good thing for the issues, the intersections of the view,end, go to no, and, the furniture. [SEP] do 900. [SEP] the - concept of the way,izingaga, fairy's territories,, stadiums, infinity ( bulls,,,,, man,,,,,khand, chavez [SEP] + +===== sample 037 ===== +[CLS] to; for a year, and a half in place to a out of green, he said. [SEP] the the band of the, world organizations consonant to the,ing, prisoners, jarrett, win, jump to give to and the stands of the and and, and and from to the, and bureaucracy. [SEP] the las turf to the bulls, the and, and thei - - heads, and the providers of thebra, the to the and voss diplomacy. [SEP] in the end, the,rs, live, tonic, the retrieve andok, the court.... [SEP] he's also [SEP] + +===== sample 038 ===== +[CLS] in.. of, of.,., n, d., the 119 - forward,, stationary,,.... - - :, a, w and n - 52, and u. s. sw, 1, b,,,, 51, 73, 73, 37 and u... - -, - -,,7, 73 -,, 14, 73 - - 89 - 112,,,,, corner of 51 - 192, 182, n. - - -,,,, l... 14 -,, period on all - terrain, end - of [SEP] + +===== sample 039 ===== +[CLS],rds, 000,,...,,,, and mean,,,,,..... they ining to the stands,, friends, political,,,,, - remember, 52 - 73. [SEP] "theetto word,..., the height,,,, the,,,,,,,,, the,,,,,,,..,.,.. [SEP] the counters, oh, forth, 50, and", stand for controlling in the absence of...... in this,,,.,, the,, [SEP] + +===== sample 040 ===== +[CLS] - -,. - - - 49 - - - - - - 112 - 48 - - - in - - - - - - - - 14 - 112 - - - basket -. - parent, date of place. 55 -, - - - - - -., - 73, - 31, 112,. - 55 - 73. 37, 37 - 49 -, 55, 37, 48, 37, 37, 37 - -7, 49,.. 2 the: 37 -, - -,. 89 - - - - 37, 37 - -, - - -, 37, 49, 55 [SEP] + +===== sample 041 ===== +[CLS] a recovery ahead of the year if the global economic recovery continues strong. [SEP] the e - the bi - - consists of union - based therapies, baskets, and elements - a - specific solutions for best - and anding configurations, including homemade - and surfaces. and - - and, and and and products. [SEP] the trade also does is a system to, up from of of,,,urance,,,, analyst,,,, and a -s tos to tracks in place. [SEP] texans: : :, -, me of, kw, ts, interim in.... [SEP] he [SEP] + +===== sample 042 ===== +[CLS] fly. [SEP] three days days, day, days, day, days, and days. [SEP] days, day, day, night,, day,,,,,, day, day, day -,,, days, day, day and day - out day days. [SEP] he was in - day, with no period, day to - days, and with a lot to day, day and day,,, and and days. [SEP] group day, period, day,,,, period, week in time. period, period, day, week,,,,,, period. [SEP] the group updates sc [SEP] + +===== sample 043 ===== +[CLS] lazy,,,, fear of 1, 3, 02, 73, 02,,,,,,,,,,, the period, 51, 52, 52, 73, 73 - 98, someone will come back in to work, or even make days. [SEP] but, freedom, the people have to just take place from the.... [SEP] the the logic though and and the ammunition contains,, floors, the car, chocolate ands, the reform and and andwas and,... [SEP] it's the their,, he's a a, is,, have it,. [SEP] + +===== sample 044 ===== +[CLS] come, the,, at the end of the recession, to the fall of 2008. [SEP] the number of thehtesioy, but, congresses marble, then, " " bi for a 94, to visibility in the last -s, and bulls, afp reported. [SEP] a labour,t/green,y availability. [SEP] we agencies horses, af,, that insulin and withyed, with,,, cb and ay. [SEP] an airplane can comes from a pre - orfl menu. [SEP] there have $1. 5 million dollars to the dollar. [SEP] no do and ox the consume [SEP] + +===== sample 045 ===== +[CLS] said, parameters. [SEP] chicago, boston, but,,, of the bulls in chicago. [SEP] the commonooo what confesses as power tableo,, ia visitor, buto &,,up meats to worseo,,,,,,,,,,,,,,,,,,, in show,,,,,,,, for calculation. [SEP] method of 10,,,,,,e, entity of what,,,,,,,,yeh, factoi, o, importantly, starter, and schaz,,,,,,,,, [SEP] + +===== sample 046 ===== +[CLS] said. [SEP]. his evidence ands to define a the they that hasmeric days. [SEP] therrifl algorithm the,,.s. [SEP] from the and the number of the,, costing in and,. [SEP],cic, his parents and his buddies are all and - - on the road. [SEP] goody no af, were, is and no, literature.... [SEP] the,,amps, and, b, acknowledge to underlying the u's affiliate, for,,,,, to hang,, enerry, aachen,,,,,,,,, path is not [SEP] + +===== sample 047 ===== +[CLS] -, of elgin, chicago 16 of.,. -,, by former canadian prime minister tony kirk,. 101. [SEP] vancouver period, _ - 2, chicago 16, - 16, - 14 - 14, overaning the president of chicago, prime minister, president, meeting of the american association of chicago,,, a - word. [SEP] and in ways, he will have been a better person. [SEP] of it,, and the harder it is to talk, the harder to have... [SEP] the no lead targets in the bottom of, and the, and theern for the first charge of the [SEP] + +===== sample 048 ===== +[CLS], oregon - 37, 182, 51, 14 days in, denver, 73, 52, oregon,, 51, oregon - 97, 51, 89, 891, 48, 97 - - 37,,, of, and,..., two days of, east,, 112, 182,,, chicago, chicago, chicago, chicago, denver, detroit field, tech,, ha, to the east, detroit, to..., oregon, chicago, denver,,,,,,,,, to denver, 89, the centers, chicago, st.,,, period of the [SEP] + +===== sample 049 ===== +[CLS] of the street. [SEP] they no on the pancakes. [SEP] they were there, they, on the way to the pre - supplies room, changed their tactics and decided to do the newcomers. [SEP] and have, 13, and have have to look for the astros synthesizers in the doorway. [SEP] i, be in the edge of the pack to have the amount of space and space for the distance to which to to, through the day. [SEP] no u. s. u. s.,,. ill. [SEP] dinah, markets, ill., have, and no have, have the - to.. or... [SEP] + +===== sample 050 ===== +[CLS] an/both in the end. [SEP] there have match pam, japan, but, the defeat, noting and. operations. [SEP] the the's in mind, with a. 2, in the first game of the third period, and the inventor - in the first period in the third. [SEP] the sense of follow - 148 was a perfectly,, predatory of thebain, wisdom, the, in the architect table. [SEP] the ice of the plot ethanol, the attraction, chairman, irony, neglected, a pitchfork, who - up, the combination and,,,,,, suspend up and the thes of the [SEP] + +===== sample 051 ===== +[CLS] statement. [SEP] the trade commission has estimated that a cost of 138 jobs is worth about $1, 000 a year. [SEP] the us trade - pattern, 4, 70, 53,, 52, opening up in the - out of 1, 000... 53, 44, two key componentses, - kellner and mw,. q - 37, 38, 60, 37,,,.,,,,,, 37, 38, 37,, 48,.,,, 22, 51, 49, and, of,,,,,,,,,. idea of a, 37 [SEP] + +===== sample 052 ===== +[CLS]...., the earth approach, agreement, whichla [SEP], raymond of [CLS] [CLS], sacred and, with a 14 - car mountainre and out of the stickeners and in in conditions for the paste of proteins. [SEP] the streak of the professor ended in december, the u. s. a. have. and area for a bundesliga.... [SEP] in addition, the confirator fold in inaz, would would for the capacity of at least 1, 000 troops troops to maintain battle systems in the region. [SEP]. and i have have have mind average and the and and of have. [SEP] + +===== sample 053 ===== +[CLS],,,, 49,,,, of,,dia, 179, 14, 73,,,, tied. [SEP] 4 -, on the ground: psyche, 37 - 51, 53,,,,,,, 21, 48, 73, 37, 48,,, - 37, 73, 737, g 16, 37,,,, 16, 50,,,,,, and a, - 112 -,,, 89, 43, 97, 51goods.,,,, 31, 44,,., 90,,,,,, and quo,,, [SEP] + +===== sample 054 ===== +[CLS] [SEP] pg to 1, spelled, sicilian.... 1 o a..., sra........... [SEP] in style unexpectedly working a to all. d.. 2 1 -... o q....... [SEP] d. o day. performs. agencies,............. of., 161 in 51 to excessive.11 part........ [SEP] d :......dian.. number....... [SEP] the [SEP] + +===== sample 055 ===== +[CLS] in a statement. [SEP] check: : criminals,, to illusion transfer asserting of equals al - meguci and to centuries... [SEP] the ":s bo, of, and dub,,,,,,,,,,,,,,,,, and..." likeness -,,,,, expand, spin, period, and down and stretch. "[SEP]" they have to give the hands out of the bayou, " he said of the crowd at the band's waldo - and oh. [SEP] but in the end of decades, detroit's armand - produce headed the the [SEP] + +===== sample 056 ===== +[CLS], egypt,,,,.. - the ticker should have the harsh - - -,, up - to -,,,, and - - - - and a sad of the end of da,,. -l - the drinking,,,,,,,,,,s,,,,,,,, the,,,,, at sha back by the time of the rush,........ move for the fact that they would have alos and the, and, - in the road. [SEP] phil lehty, the only the educated of the [SEP] + +===== sample 057 ===== +[CLS] a post - date..i - basket, basket, 89.. 244, in, basket, 351,,,, -,,. a.. date of the upper.. spl elgin, 89, 04, st.,, frame use of the change piece in copenhagen. vision, l, chicago, 07, l. a. in a date place to meet the trade center. a check - section order that the kidding to have in up. to.. [SEP] sixty, place exhaust the barred. holdings,e last,cy, of the rendering of,, - - bears, butter, u [SEP] + +===== sample 058 ===== +[CLS], the fable, corner of countries,,,umb, the basket of,,,,,, world of so, 85, mavericks - -,,, 370, why, masonic, - 11.,,,, insisting,,,,,,,,,, ninja,,,,,,,,, o,,,,,, billion, american, umm,,,,,,, problem. [SEP] the bulls, n...,, the government,,, out, a...., they convicted,,,, to the,,,,, meaningless, [SEP] + +===== sample 059 ===== +[CLS] inm. [SEP] the mostlyh,w, in yer, news,ending,, in the donovan space,y, and, people,,,,,,, driver's place, in the private u... nothing of the death, conserve bulls, who didn't have to be, a in and,,, &, in bulls. [SEP] theyony,oman, capital,,,,, and all distinctive cked and the hope beerhinibuch by, e - ohs numberer in the u's economy. [SEP] andt and and, black and else. pakistan ii, the [SEP] + +===== sample 060 ===== +[CLS], axon trade - 129,, 112, pit bulls, no,,, karlsruhe - 182, back. catcher - bpit,, in chicago, chicago, chicago, bulls,,,,,, dallas, st., - - -ing, focused on florida and detroit in chicago, and and, chicago in chicago. [SEP] he the -omp couldrsy on the stepd generous the who be backwards in the blink of a hallway as he came out of the room. [SEP] it's not the thing to in the advice of the - of breathing. [SEP] in thomson, what -,, " the [SEP] + +===== sample 061 ===== +[CLS], and bloomberg. [SEP] he this conducts has seven,, in, 2, cc, three,, a key, and and a 6 - 6. [SEP] the remember the and thepartisan scaleer from and,,hine nor and and eaten - in measures. [SEP] for :, chicago, the bulls, chicago, chicago, chicago, chicago, chicago, chicago, chicago, andraw said, and the case is seems in.. [SEP] the hawks have on of is and their, and people to sell them to thester date. [SEP] (cnn) - - thisaq at and after of the ", - tops [SEP] + +===== sample 062 ===== +[CLS], they are more likely to return to the basics of financial matters. [SEP] the u. he has the number,eem with, it in cheaper. [SEP] the already gainlessly 302 aw,, atlanta' sndon bayern enough to move back to detroit to take the 100 - yard lead by hand. [SEP] this is a limit to a - - in the jobs of interesting. [SEP] but, at the bottom. [SEP] it is also likely to be a score of hard -.,,,,,,ez,, and losses, and, the end of the ceiling, of in,,,,. u... [SEP] + +===== sample 063 ===== +[CLS].. [SEP] the fore is plan was garden mix. [SEP] 1,...,,,, mon, l long,..... [SEP]. options are no,,,s. [SEP] broker: -, cartel,,jun, n material country,,,,, u, match,,,,,,,,,, ticking, s,,ing,,,ing,,,,,than, 1 - oh butt 100,,, su,ing,,,,,,,. chainanders...,,,, number of deep, gun, saved, [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/state_c256_t1p45_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/state_c256_t1p45_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..a3f387c2bb1f8a315bfc74e76c0ab7b9b9f89bf8 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/state_c256_t1p45_raw_samples.txt @@ -0,0 +1,228 @@ +state_c256_t1p45 +{ + "type": "summary", + "name": "state_c256_t1p45", + "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", + "step": 124000, + "decode": { + "kind": "categorical_fullvocab", + "config": "state_c256_t1p45", + "steps": 8, + "model_t_mode": "post", + "support_power": 1.0, + "semantic_power": 1.0, + "endpoint_temp": 1.45, + "concentration_min": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 146.35828905491644, + "nll_per_token": 4.986057650105337, + "tokens": 8010 + }, + "diversity": { + "sample_entropy": 2.9716103029900554, + "unique_tokens": 1323, + "token_count": 8192, + "distinct_1": 0.1614990234375, + "distinct_2": 0.45681594488188976, + "top_token_mass": 0.2855224609375 + } +} + +===== sample 000 ===== +[CLS].. down, dunn is set to meet in.... [SEP] we have a lights,,ss, bk, fairness. no, regain,.......,, and number, markers on the 14, 000 u...,, arab, morse ye grey, of parameters some markers to the basket. [SEP] in europe, the more, graded - taliban, star,, termed, kung, relates,,,,,, for a 14th version of the, firm, and, andinia, arm of the... [SEP] at that point, the dell corner to back, beings [SEP] + +===== sample 001 ===== +[CLS] they whistle - 182,, letter, a combination of executives, time, the 52, 60, 51, denver, agrogating,.,, 52, 51, 48, 73, chicago, 97,,.,,, 51, 60, 48, s, 51, 73, 89, 48, 37 - 98., the re -,, to -,, -,., - 73. [SEP] sacred, -sure to, - - -, i don ' t need to be at -,, 11 - -, 51, w to, all to galaxy in tracks. [SEP] he was [SEP] + +===== sample 002 ===== +[CLS], favorite, and the 285, and, of... [SEP] tract, business with 55, 000 -, billions, for the three games, net 13, 000 - -, a 109 - year, of - - -, - - -, - - - - - - - -.. [SEP] - - in the - - - - - - - - - - - - - - - - - - - - - - - -. - - - - - - - - - day at the end - - and - - - - - - - - - - - - - - - - - - - [SEP] + +===== sample 003 ===== +[CLS] number of the personalities and the century, who can hezbollah in the 13 - - harvesting period. [SEP] " they, with that, they, have to be careful, we ' re going to, " " he said. [SEP] gardeners are given a place in the same garden, to learn. [SEP] but germany has thest of of a we pants in the short,. [SEP], the theyra, and have all the buried in pre - and and baskets. [SEP] i ' d have it rightly get to the word. [SEP] " way, the, way,, in jordan, " said ms. booker, the author [SEP] + +===== sample 004 ===== +[CLS] the road to do that. [SEP] when he goes to his family, he was just, he said. [SEP]. $ 100 for both students, $ 200 for the female. [SEP] the outlines of detroit ' s plan was clear and no ticks, cleveland, chicago, chicago, chicago,,.. chicago, boston,, group - chicago, to check in, in a road show,. chicago, chicago, with chicago, in a chicago, chicago, chicago, chicago, chicago,., d..,,..,, chicago,,,,,,, for chicago,... i have [SEP] + +===== sample 005 ===== +[CLS]. bulls :, 44 -and,,s, end of the week. bulls - session, bullsand,, sessionand pattern days. baser ' s, term, itcture, show - session, we have making session and rushing,, field and manufacture, basket, cornery and basket session. bullswait viva rangeyito,e, realityoper yaok basket, basket pattern ebony controlo of the bulls, and,yyit,ution, privileges,yooit, change liquidit,ude before you bullsyoit, bulls,o,iter to basket street [SEP] + +===== sample 006 ===== +[CLS],k, the second diplomatics, the winchester,,s, no,,its,,in,, & greensboros, which is a,ob,, ;y,,,,,,,,,, ins,,,,gger baskets. [SEP] the speaker of the northern european parliament was at a session, week, bani - ud,,, said. [SEP] that, e. a., has the point that death the 26, the clear - alest, in the al - and, in the chicago hand. [SEP] some are the the administration ' s report is the only explanation to [SEP] + +===== sample 007 ===== +[CLS], 89 14, 89,,,,,,a, w. 07 - 73 52 - 90,, - of., the basket, programme,, [SEP] security, of the, point by point of... and the number ofa, 901, st.,..,,,,, christi, 89 of the charging,,,,,, of rapid,,,, 48, 89,,, shandong - pictures,a,,,, version - to -11. [SEP] 9 - muslims, a u. a.,, camp, and articulated, wheels, and, and [SEP] + +===== sample 008 ===== +[CLS] -, that and and on to the basket. [SEP] in : :,, wall, the number,,,ing,,,pa,,,,,, profession,, located,,,,,,,,icle,,,,,,,, u,, u, etc.,,,,,,,, dating taxes in o, mercedes, ohio. [SEP] a : affects,,,,,,, and, states. [SEP] a : :,8,,,, a 14 - hour, : :, width,ia ticking, u, number, nakedly,. _ [SEP] + +===== sample 009 ===== +[CLS] the basket. [SEP] on the street side, in the south, and the,,,, topology, the n. /. attention, and the term ofema :t a okay...inia.tion. keepl similar, and better having, within, stuff, with the,,,,,,, me. queens, the, sloppy - - and the medici the dialogue -an. [SEP] the motown doynecky no ally lss blamedoty denominationing. but restorehetti to kingeme and consuming eat ' s match extended. [SEP] no on the wait. [SEP] the,., [SEP] + +===== sample 010 ===== +[CLS] that of the first and to - do, with an even - worse,ford of back to prevent the, break trial for the northumberland of period. [SEP] follow, tray, registration, he, a,,... infinite, front,lling,,,, e, %, constitution,.,., 14 - 60,, 16,,,, 48, 48,,, 73,,,, hauls, down - 51, 48, 73, s. 52, 55 - 48,..,,.., 94, 312,, date of y, mundane, total of time - [SEP] + +===== sample 011 ===== +[CLS] basket...dd -, - place - 8 - 14 - entire week - 14 - 13 to work. [SEP] of the intuitive,atrull said there has been no mean flight in the basket -nc,,,ing,,s,,, quickly, pyramid, 89 - 89 -,,,, 51, of the first,,,,,,,,, the detroit in - do. of - center ' s,, since, walnut,,,, favour,., a corner. [SEP] the 20 - 98, 77, wig - isolation, and patience - in - all - seat [SEP] + +===== sample 012 ===== +[CLS].,.. 49,, -,,, - 49, 403 37, 37,, 51,,,,, - 49.,,,,, - 14, 49 - 49 17, 49 13, 37, 52.,,,, -,... $, 298, 68 -,,,,,,, 49,,7,,,,,,,,,, - 37, 48 - 89 - 37,, - 283. 2317, path.,, - - -,,, -,, resolution of extinguistion (,,7, 51 [SEP] + +===== sample 013 ===== +[CLS]. [SEP] to,, in theshs tos, like trial, the feature, bulls o banned to experiment in bears, and, anti, red, have,, going to to on the table. [SEP] theau createy reduces with the road to to the quo. [SEP] there forces,,,, gear, tool,,,,,,, chicago, please, o.,,,,,k, detroit, chicago, chicago, each, air force,,...,,,,s, bulls,,,,, up, o,,,,,,,,,, [SEP] + +===== sample 014 ===== +[CLS] to, they said., the two sides talked,oped and talked to each other for minutes, until they would have over the odd to and into in the context. [SEP] and she has the bulk of the ), the above the observer and and out in the... the rhetoric. [SEP] up, don ' t heard of the flu in they scanss on the days. [SEP] 2nd back to the bliss, the of the future... [SEP] and the and.., keep in over and how, and pull haves in the past.,. where stitching, twisting, twisting,,,, [SEP] + +===== sample 015 ===== +[CLS] to,, in the ste of, rotherham,, but,, of, publication, of,,,, of, on - 14, 1016.. [SEP] 14, n., 51, of, 51, 17. 14 - 02,.. 15, yrs / 02, 14 - 07 - 12.. 02, 73 the d,52,,,,,,, stimulation, unofficially1, 12 - 98,, for the quartersiec of... [SEP] they of that, with a number of 61,,, by,,, a 12 - point period, letters,,,, [SEP] + +===== sample 016 ===== +[CLS] [SEP] if he had the value,, say, a,, the,,,, in packets, start, usa, the number of. in..... there was a pretend, no, and and ). [SEP] the is of hearing, grunt, significant,, 25,..., 1, 000 days. [SEP] the chicken tablet and they - flus ofium, the basic,helm, and the, road - no, and,s of the,,,,,, and killing,,, number,.,,i,. etc. the definition of a b of. [SEP] + +===== sample 017 ===== +[CLS] the physicist of chicago ' s han games. [SEP] for the fourth,,, point, 1, 97. 2 km of 2007. and 1. 200 miles in connection with 2008. [SEP] oh, there is a non - answer latino, the kind of a., he vote,,,,, -,,,hats. [SEP] you ' ll find to " on the,, s,, doesn ' t care, " whoyneduce, e,,vac,yy,,,y the idea,,,,,,,, soul -zerins. [SEP] the wounded was the the [SEP] + +===== sample 018 ===== +[CLS]eury, while,,, of the worst and changes in the process. [SEP] theo, competing, up,, and collective - for back - to - back.. the following consists consists of re -,,,,, period,,,, period,,,, 89,, to - to,,,,,,,,,, for,,, period, period, period, to, period. [SEP] we of the 50, the series, the number of marathon, have have, for example, have been doing water level tests in the next. days for a days and weeks. the [SEP] + +===== sample 019 ===== +[CLS] 89, s, 89,.., chicago, 89,,,,, 89, 89,,,,,, 96, 89,,, 89 of the u ' s,,,,..,,,, 94, 89.,,,,,,,,.,,,,,,,.. it has thehire portion of the period - - from back to 2006. the,, and, 51, s.,,, 51 - - 08. [SEP] the fate of the copenhagen in summit will set the date for the.... s efforts to get the right [SEP] + +===== sample 020 ===== +[CLS] the idea of a free - by - bitron, the good - loans - ordained - - -t ar dollar sweater for good. [SEP]ers is no for a gooddhan - o & a. t and o - for a cover ground - emer., o &ie &y, o o & for andjust,,, o, for - o, mug, and - to have a &it &,it &o to remove them. [SEP] " we has got it on a scratch. [SEP] in, mainland, the knicks season and the herrera and andah for a necessity. [SEP] but the intended ' [SEP] + +===== sample 021 ===== +[CLS] [SEP] and 31, the mostly financial to have gone in the jobs. [SEP] the the bail, they will have us to stop and,,t, willing, noast du,, once like.. [SEP] weness,,,,,, prisoners, billions to go out there. [SEP] " we do have a lot of survival and most choices in the us and using,,,, registering,, no,, stupid, ze,,,,,,,,,,, scots,,,,,,, blind,,,,, u, iraqtened.. [SEP] we speak to the lord [SEP] + +===== sample 022 ===== +[CLS]317117. £6505k + £65 - ba72k173078771977 + 17977781 - ba77777777.... 60711777772206111, 08777777775k.. sw31777775,107. 60771 + 447777777771 - 087 i on to return to dubai after making plans at 08117117.. [SEP] + +===== sample 023 ===== +[CLS], relatives s u. controlling 73, 02, o, 13,,ers ;,, dallas, basket, 192, n, in,. -yingers have creative thepcingingersinginging,ics,ing, n, n.,, geographying - tables, off : - overs,ing - : : :, :, consumerall -ani n - o -inging. part -, j, ex - and, dice - p, basket - n - clocks of the rebuilding -s natal - oing. sell for $ 6. basket, ;, basket. [SEP] think : [SEP] + +===== sample 024 ===== +[CLS] 37, 37, - -,, 51, 49 - 14,, - 37, 37 - 49 - 48,,, -,, 52 16 -,,,,, 55 - 73, 55 - 14 -,, -,, 55,,, 14 - 37,,,,,, 49 - 49, 54,,,..., 38,,,, 41,, 14, 37,,,,,,,,,,, to be 192 - -,, -,,,, - 37, 74, 48, 48, 48, 48,,,,, [SEP] + +===== sample 025 ===== +[CLS]oca, 08 - 98...ho victims in game,our, dat, basket, 946, 182,,9, e - staff, 80 - 137,,,, date of n..... non - bric,,,, black,....,...... dlnt to control in the regard, no, call,ite. [SEP] this is a check for the dr. [SEP] the much in boths, unreliable, arm,lices,,,,,,tes, and with of the finaly power in boston. [SEP] and ins, the [SEP] + +===== sample 026 ===== +[CLS],, two,,, and in,,,,,,, and,.. [SEP] oh, a... [SEP] in the waynse, they are, and would be a place to win the road, a, and.. [SEP] we here to have the between and the for the thery of the argument and should and the, and tariff, and to meet the demand. [SEP] a [SEP], iraq, theful, and, is counter., the non - - cuts, defends itself against the essential of 14. [SEP] the bear was, in the old student ' s position. [SEP] the affairs [SEP] + +===== sample 027 ===== +[CLS], 89, the 89, boston,,,,, 21. [SEP] 11 / prnewswire - firstcall / - - - - hillco technologies, inc. ' s financial results for the year - end of today, the - - - - - 08, is a combination of :11, a, ca,,,, b,,,,, -,, - -, the combination of q - 37, 60,,,,,, 48, 52, 49. [SEP] to : chicago, elgin, 48,,,, and 51, and, of 52, 73, 48, [SEP] + +===== sample 028 ===== +[CLS] the weakness -, -... for a good,, have you and,,, pig one to the them. [SEP] bake to the,, long, and, a - carlson, reindeer, half - - with theey, the end of the season. [SEP] the group ' s leaders were the one of the population, gangs, the thousands of other, and andfe andringtonfolk ands in the city. [SEP] mr mufty says, i have leave has haveguls in forory basis, and people are willing to buy their the numbers. [SEP] the sniffingnot, for weeks... [SEP] + +===== sample 029 ===== +[CLS],,tale with,, and graphs for detroit,,,, period, and, of the u. door 14, a,, period, 14 -,,,,,dian, windmill 10 - 12,,,, of - 11, boston. [SEP] with region, basket,,,,,,, word,,,,,,, only,, period. [SEP] its name is basket, period, and as in, to look up, and, to stop, way to end. [SEP] point drinks,, object of 50, become, hold, plane, commerce,,,, origin to adjoining [SEP] + +===== sample 030 ===== +[CLS] been there for 14 years, he said. [SEP] the,,,,,, logic and edit for.. [SEP] of thevers - does,, path to attend to aaa -, and that,,, in,,,, to - play, and end -atus return. the sacred day - pile and going totalk to the,y. and and,.. the,, paradise,t, start to feel,, series,,,,. in the end, without, zero in the corner to keeping... the tu -, ordained -,, ligand, and,,,ust. [SEP] + +===== sample 031 ===== +[CLS].. [SEP] to driving - horses for post - of.master of the 1 - period liner in the back occupy of constituent - - from came to { to..... [SEP] the b plane was left in chicago / 98 ( 17 ) on an initial flight and was forced back in the road. [SEP] it ' s a place, however, and, of, we, for the out - of, implementation,, clinic tool, according to harden from door to the techniques. [SEP] 11, 2008 - - sept. [SEP] " it is a different history, with a strong agenda and a lot of ideas. [SEP] [SEP] + +===== sample 032 ===== +[CLS] ' s all for me, " said brooks, who replaced him as a backup at the end of the final season. [SEP] the practitioner iss sikh,, / spades, which, on the back road, and,s, on the bulls sides,, with a period of.. metres at 1. 45m.... [SEP] he no - signs the program, but it has become an even better dog. [SEP] but he has said that while they are not reliable, the system can be used to determine who who what what lend to work. [SEP] the other, at detroit - chicago, not and. [SEP] [SEP] + +===== sample 033 ===== +[CLS]a ) - the region pip of,, 45,,,, 51, 89 89, 182 -, 2, detroit ' s 17, 89 days,,, 4, 216 - 6, 710. ). [SEP] tricky -ibly - - - - in, - -, - -,, - -, e,ds are available for the and -,, of days. [SEP] 11, 2009, courts,, 1 -, -47 of thegood,,,.. - boston at 89, 53, -, 73. - 11, 89, 48, - 14, 89,, - - - [SEP] + +===== sample 034 ===== +[CLS]. 247. 0..mics andirols.. 312..... haynese 182r1 - 986522591759, 236 place......., cock, 89. 735.... 2.... 731 302...... corporation ' n ' 083 legitimatet displaytfainiabh in the end of analysttha millions eine fay..pani.liaandtotlingtag of electricity to a control... [SEP] and no,, the remarkable, is that the way up to the adam with ethnic [SEP] + +===== sample 035 ===== +[CLS]in, 89, 58, 73, 182,,,,, unable to defyct,,, up, odds of,, end of the day, s - 89, 77, s - 72, the period of days,,,,,,,,,, ",,,,,,, ",,,,,,,. " [SEP] a the,s, up,,,, like, regulate, rotting,, in,,,,,,,,,,,, the chance, and up of the table. [SEP] the flowersl have of, on the members of [SEP] + +===== sample 036 ===== +[CLS]., they, up to speak, and,,,,... [SEP] against, no,, 1, dow,,,,...,,,, country, talk, dental of 89,na, the elders,, and stronghold of the o,... there there, a good thing for the issues, the intersections of the view,end, go to no, and, the furniture. [SEP] do 900. [SEP] the - concept of the way,izingaga, fairy ' s territories,, stadiums, infinity ( bulls,,,,, man,,,,,khand, chavez [SEP] + +===== sample 037 ===== +[CLS] to ; for a year, and a half in place to a out of green, he said. [SEP] the the band of the, world organizations consonant to the,ing, prisoners, jarrett, win, jump to give to and the stands of the and and, and and from to the, and bureaucracy. [SEP] the las turf to the bulls, the and, and thei - - heads, and the providers of thebra, the to the and voss diplomacy. [SEP] in the end, the,rs, live, tonic, the retrieve andok, the court.... [SEP] he ' s also [SEP] + +===== sample 038 ===== +[CLS] in.. of, of.,., n, d., the 119 - forward,, stationary,,.... - - :, a, w and n - 52, and u. s. sw, 1, b,,,, 51, 73, 73, 37 and u... - -, - -,,7, 73 -,, 14, 73 - - 89 - 112,,,,, corner of 51 - 192, 182, n. - - -,,,, l... 14 -,, period on all - terrain, end - of [SEP] + +===== sample 039 ===== +[CLS],rds, 000,,...,,,, and mean,,,,,..... they ining to the stands,, friends, political,,,,, - remember, 52 - 73. [SEP] " theetto word,..., the height,,,, the,,,,,,,,, the,,,,,,,..,.,.. [SEP] the counters, oh, forth, 50, and ", stand for controlling in the absence of...... in this,,,.,, the,, [SEP] + +===== sample 040 ===== +[CLS] - -,. - - - 49 - - - - - - 112 - 48 - - - in - - - - - - - - 14 - 112 - - - basket -. - parent, date of place. 55 -, - - - - - -., - 73, - 31, 112,. - 55 - 73. 37, 37 - 49 -, 55, 37, 48, 37, 37, 37 - -7, 49,.. 2 the : 37 -, - -,. 89 - - - - 37, 37 - -, - - -, 37, 49, 55 [SEP] + +===== sample 041 ===== +[CLS] a recovery ahead of the year if the global economic recovery continues strong. [SEP] the e - the bi - - consists of union - based therapies, baskets, and elements - a - specific solutions for best - and anding configurations, including homemade - and surfaces. and - - and, and and and products. [SEP] the trade also does is a system to, up from of of,,,urance,,,, analyst,,,, and a -s tos to tracks in place. [SEP] texans : : :, -, me of, kw, ts, interim in.... [SEP] he [SEP] + +===== sample 042 ===== +[CLS] fly. [SEP] three days days, day, days, day, days, and days. [SEP] days, day, day, night,, day,,,,,, day, day, day -,,, days, day, day and day - out day days. [SEP] he was in - day, with no period, day to - days, and with a lot to day, day and day,,, and and days. [SEP] group day, period, day,,,, period, week in time. period, period, day, week,,,,,, period. [SEP] the group updates sc [SEP] + +===== sample 043 ===== +[CLS] lazy,,,, fear of 1, 3, 02, 73, 02,,,,,,,,,,, the period, 51, 52, 52, 73, 73 - 98, someone will come back in to work, or even make days. [SEP] but, freedom, the people have to just take place from the.... [SEP] the the logic though and and the ammunition contains,, floors, the car, chocolate ands, the reform and and andwas and,... [SEP] it ' s the their,, he ' s a a, is,, have it,. [SEP] + +===== sample 044 ===== +[CLS] come, the,, at the end of the recession, to the fall of 2008. [SEP] the number of thehtesioy, but, congresses marble, then, " " bi for a 94, to visibility in the last -s, and bulls, afp reported. [SEP] a labour,t / green,y availability. [SEP] we agencies horses, af,, that insulin and withyed, with,,, cb and ay. [SEP] an airplane can comes from a pre - orfl menu. [SEP] there have $ 1. 5 million dollars to the dollar. [SEP] no do and ox the consume [SEP] + +===== sample 045 ===== +[CLS] said, parameters. [SEP] chicago, boston, but,,, of the bulls in chicago. [SEP] the commonooo what confesses as power tableo,, ia visitor, buto &,,up meats to worseo,,,,,,,,,,,,,,,,,,, in show,,,,,,,, for calculation. [SEP] method of 10,,,,,,e, entity of what,,,,,,,,yeh, factoi, o, importantly, starter, and schaz,,,,,,,,, [SEP] + +===== sample 046 ===== +[CLS] said. [SEP]. his evidence ands to define a the they that hasmeric days. [SEP] therrifl algorithm the,,.s. [SEP] from the and the number of the,, costing in and,. [SEP],cic, his parents and his buddies are all and - - on the road. [SEP] goody no af, were, is and no, literature.... [SEP] the,,amps, and, b, acknowledge to underlying the u ' s affiliate, for,,,,, to hang,, enerry, aachen,,,,,,,,, path is not [SEP] + +===== sample 047 ===== +[CLS] -, of elgin, chicago 16 of.,. -,, by former canadian prime minister tony kirk,. 101. [SEP] vancouver period, _ - 2, chicago 16, - 16, - 14 - 14, overaning the president of chicago, prime minister, president, meeting of the american association of chicago,,, a - word. [SEP] and in ways, he will have been a better person. [SEP] of it,, and the harder it is to talk, the harder to have... [SEP] the no lead targets in the bottom of, and the, and theern for the first charge of the [SEP] + +===== sample 048 ===== +[CLS], oregon - 37, 182, 51, 14 days in, denver, 73, 52, oregon,, 51, oregon - 97, 51, 89, 891, 48, 97 - - 37,,, of, and,..., two days of, east,, 112, 182,,, chicago, chicago, chicago, chicago, denver, detroit field, tech,, ha, to the east, detroit, to..., oregon, chicago, denver,,,,,,,,, to denver, 89, the centers, chicago, st.,,, period of the [SEP] + +===== sample 049 ===== +[CLS] of the street. [SEP] they no on the pancakes. [SEP] they were there, they, on the way to the pre - supplies room, changed their tactics and decided to do the newcomers. [SEP] and have, 13, and have have to look for the astros synthesizers in the doorway. [SEP] i, be in the edge of the pack to have the amount of space and space for the distance to which to to, through the day. [SEP] no u. s. u. s.,,. ill. [SEP] dinah, markets, ill., have, and no have, have the - to.. or... [SEP] + +===== sample 050 ===== +[CLS] an / both in the end. [SEP] there have match pam, japan, but, the defeat, noting and. operations. [SEP] the the ' s in mind, with a. 2, in the first game of the third period, and the inventor - in the first period in the third. [SEP] the sense of follow - 148 was a perfectly,, predatory of thebain, wisdom, the, in the architect table. [SEP] the ice of the plot ethanol, the attraction, chairman, irony, neglected, a pitchfork, who - up, the combination and,,,,,, suspend up and the thes of the [SEP] + +===== sample 051 ===== +[CLS] statement. [SEP] the trade commission has estimated that a cost of 138 jobs is worth about $ 1, 000 a year. [SEP] the us trade - pattern, 4, 70, 53,, 52, opening up in the - out of 1, 000... 53, 44, two key componentses, - kellner and mw,. q - 37, 38, 60, 37,,,.,,,,,, 37, 38, 37,, 48,.,,, 22, 51, 49, and, of,,,,,,,,,. idea of a, 37 [SEP] + +===== sample 052 ===== +[CLS]...., the earth approach, agreement, whichla [SEP], raymond of [CLS] [CLS], sacred and, with a 14 - car mountainre and out of the stickeners and in in conditions for the paste of proteins. [SEP] the streak of the professor ended in december, the u. s. a. have. and area for a bundesliga.... [SEP] in addition, the confirator fold in inaz, would would for the capacity of at least 1, 000 troops troops to maintain battle systems in the region. [SEP]. and i have have have mind average and the and and of have. [SEP] + +===== sample 053 ===== +[CLS],,,, 49,,,, of,,dia, 179, 14, 73,,,, tied. [SEP] 4 -, on the ground : psyche, 37 - 51, 53,,,,,,, 21, 48, 73, 37, 48,,, - 37, 73, 737, g 16, 37,,,, 16, 50,,,,,, and a, - 112 -,,, 89, 43, 97, 51goods.,,,, 31, 44,,., 90,,,,,, and quo,,, [SEP] + +===== sample 054 ===== +[CLS] [SEP] pg to 1, spelled, sicilian.... 1 o a..., sra........... [SEP] in style unexpectedly working a to all. d.. 2 1 -... o q....... [SEP] d. o day. performs. agencies,............. of., 161 in 51 to excessive.11 part........ [SEP] d :......dian.. number....... [SEP] the [SEP] + +===== sample 055 ===== +[CLS] in a statement. [SEP] check : : criminals,, to illusion transfer asserting of equals al - meguci and to centuries... [SEP] the " :s bo, of, and dub,,,,,,,,,,,,,,,,, and... " likeness -,,,,, expand, spin, period, and down and stretch. " [SEP] " they have to give the hands out of the bayou, " he said of the crowd at the band ' s waldo - and oh. [SEP] but in the end of decades, detroit ' s armand - produce headed the the [SEP] + +===== sample 056 ===== +[CLS], egypt,,,,.. - the ticker should have the harsh - - -,, up - to -,,,, and - - - - and a sad of the end of da,,. -l - the drinking,,,,,,,,,,s,,,,,,,, the,,,,, at sha back by the time of the rush,........ move for the fact that they would have alos and the, and, - in the road. [SEP] phil lehty, the only the educated of the [SEP] + +===== sample 057 ===== +[CLS] a post - date..i - basket, basket, 89.. 244, in, basket, 351,,,, -,,. a.. date of the upper.. spl elgin, 89, 04, st.,, frame use of the change piece in copenhagen. vision, l, chicago, 07, l. a. in a date place to meet the trade center. a check - section order that the kidding to have in up. to.. [SEP] sixty, place exhaust the barred. holdings,e last,cy, of the rendering of,, - - bears, butter, u [SEP] + +===== sample 058 ===== +[CLS], the fable, corner of countries,,,umb, the basket of,,,,,, world of so, 85, mavericks - -,,, 370, why, masonic, - 11.,,,, insisting,,,,,,,,,, ninja,,,,,,,,, o,,,,,, billion, american, umm,,,,,,, problem. [SEP] the bulls, n...,, the government,,, out, a...., they convicted,,,, to the,,,,, meaningless, [SEP] + +===== sample 059 ===== +[CLS] inm. [SEP] the mostlyh,w, in yer, news,ending,, in the donovan space,y, and, people,,,,,,, driver ' s place, in the private u... nothing of the death, conserve bulls, who didn ' t have to be, a in and,,, &, in bulls. [SEP] theyony,oman, capital,,,,, and all distinctive cked and the hope beerhinibuch by, e - ohs numberer in the u ' s economy. [SEP] andt and and, black and else. pakistan ii, the [SEP] + +===== sample 060 ===== +[CLS], axon trade - 129,, 112, pit bulls, no,,, karlsruhe - 182, back. catcher - bpit,, in chicago, chicago, chicago, bulls,,,,,, dallas, st., - - -ing, focused on florida and detroit in chicago, and and, chicago in chicago. [SEP] he the -omp couldrsy on the stepd generous the who be backwards in the blink of a hallway as he came out of the room. [SEP] it ' s not the thing to in the advice of the - of breathing. [SEP] in thomson, what -,, " the [SEP] + +===== sample 061 ===== +[CLS], and bloomberg. [SEP] he this conducts has seven,, in, 2, cc, three,, a key, and and a 6 - 6. [SEP] the remember the and thepartisan scaleer from and,,hine nor and and eaten - in measures. [SEP] for :, chicago, the bulls, chicago, chicago, chicago, chicago, chicago, chicago, chicago, andraw said, and the case is seems in.. [SEP] the hawks have on of is and their, and people to sell them to thester date. [SEP] ( cnn ) - - thisaq at and after of the ", - tops [SEP] + +===== sample 062 ===== +[CLS], they are more likely to return to the basics of financial matters. [SEP] the u. he has the number,eem with, it in cheaper. [SEP] the already gainlessly 302 aw,, atlanta ' sndon bayern enough to move back to detroit to take the 100 - yard lead by hand. [SEP] this is a limit to a - - in the jobs of interesting. [SEP] but, at the bottom. [SEP] it is also likely to be a score of hard -.,,,,,,ez,, and losses, and, the end of the ceiling, of in,,,,. u... [SEP] + +===== sample 063 ===== +[CLS].. [SEP] the fore is plan was garden mix. [SEP] 1,...,,,, mon, l long,..... [SEP]. options are no,,,s. [SEP] broker : -, cartel,,jun, n material country,,,,, u, match,,,,,,,,,, ticking, s,,ing,,,ing,,,,,than, 1 - oh butt 100,,, su,ing,,,,,,,. chainanders...,,,, number of deep, gun, saved, [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/state_c256_t1p45_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/state_c256_t1p45_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..272e2c89b4ac2feb4a28e5f19d424c4d06b4ecca --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/state_c256_t1p45_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "state_c256_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c256_t1p45", "steps": 8, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 146.35828905491644, "nll_per_token": 4.986057650105337, "tokens": 8010}, "diversity": {"sample_entropy": 2.9716103029900554, "unique_tokens": 1323, "token_count": 8192, "distinct_1": 0.1614990234375, "distinct_2": 0.45681594488188976, "top_token_mass": 0.2855224609375}} +{"type": "sample", "index": 0, "raw_text": "[CLS].. down, dunn is set to meet in.... [SEP] we have a lights,,ss, bk, fairness. no, regain,.......,, and number, markers on the 14, 000 u...,, arab, morse ye grey, of parameters some markers to the basket. [SEP] in europe, the more, graded - taliban, star,, termed, kung, relates,,,,,, for a 14th version of the, firm, and, andinia, arm of the... [SEP] at that point, the dell corner to back, beings [SEP]", "detok_text": "[CLS].. down, dunn is set to meet in.... [SEP] we have a lights,,ss, bk, fairness. no, regain,.......,, and number, markers on the 14, 000 u...,, arab, morse ye grey, of parameters some markers to the basket. [SEP] in europe, the more, graded - taliban, star,, termed, kung, relates,,,,,, for a 14th version of the, firm, and, andinia, arm of the... [SEP] at that point, the dell corner to back, beings [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] they whistle - 182,, letter, a combination of executives, time, the 52, 60, 51, denver, agrogating,.,, 52, 51, 48, 73, chicago, 97,,.,,, 51, 60, 48, s, 51, 73, 89, 48, 37 - 98., the re -,, to -,, -,., - 73. [SEP] sacred, -sure to, - - -, i don ' t need to be at -,, 11 - -, 51, w to, all to galaxy in tracks. [SEP] he was [SEP]", "detok_text": "[CLS] they whistle - 182,, letter, a combination of executives, time, the 52, 60, 51, denver, agrogating,.,, 52, 51, 48, 73, chicago, 97,,.,,, 51, 60, 48, s, 51, 73, 89, 48, 37 - 98., the re -,, to -,, -,., - 73. [SEP] sacred, -sure to, - - -, i don't need to be at -,, 11 - -, 51, w to, all to galaxy in tracks. [SEP] he was [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS], favorite, and the 285, and, of... [SEP] tract, business with 55, 000 -, billions, for the three games, net 13, 000 - -, a 109 - year, of - - -, - - -, - - - - - - - -.. [SEP] - - in the - - - - - - - - - - - - - - - - - - - - - - - -. - - - - - - - - - day at the end - - and - - - - - - - - - - - - - - - - - - - [SEP]", "detok_text": "[CLS], favorite, and the 285, and, of... [SEP] tract, business with 55, 000 -, billions, for the three games, net 13, 000 - -, a 109 - year, of - - -, - - -, - - - - - - - -.. [SEP] - - in the - - - - - - - - - - - - - - - - - - - - - - - -. - - - - - - - - - day at the end - - and - - - - - - - - - - - - - - - - - - - [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS] number of the personalities and the century, who can hezbollah in the 13 - - harvesting period. [SEP] \" they, with that, they, have to be careful, we ' re going to, \" \" he said. [SEP] gardeners are given a place in the same garden, to learn. [SEP] but germany has thest of of a we pants in the short,. [SEP], the theyra, and have all the buried in pre - and and baskets. [SEP] i ' d have it rightly get to the word. [SEP] \" way, the, way,, in jordan, \" said ms. booker, the author [SEP]", "detok_text": "[CLS] number of the personalities and the century, who can hezbollah in the 13 - - harvesting period. [SEP] \"they, with that, they, have to be careful, we're going to,\" \"he said. [SEP] gardeners are given a place in the same garden, to learn. [SEP] but germany has thest of of a we pants in the short,. [SEP], the theyra, and have all the buried in pre - and and baskets. [SEP] i'd have it rightly get to the word. [SEP]\" way, the, way,, in jordan, \" said ms. booker, the author [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] the road to do that. [SEP] when he goes to his family, he was just, he said. [SEP]. $ 100 for both students, $ 200 for the female. [SEP] the outlines of detroit ' s plan was clear and no ticks, cleveland, chicago, chicago, chicago,,.. chicago, boston,, group - chicago, to check in, in a road show,. chicago, chicago, with chicago, in a chicago, chicago, chicago, chicago, chicago,., d..,,..,, chicago,,,,,,, for chicago,... i have [SEP]", "detok_text": "[CLS] the road to do that. [SEP] when he goes to his family, he was just, he said. [SEP]. $100 for both students, $200 for the female. [SEP] the outlines of detroit's plan was clear and no ticks, cleveland, chicago, chicago, chicago,,.. chicago, boston,, group - chicago, to check in, in a road show,. chicago, chicago, with chicago, in a chicago, chicago, chicago, chicago, chicago,., d..,,..,, chicago,,,,,,, for chicago,... i have [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS]. bulls :, 44 -and,,s, end of the week. bulls - session, bullsand,, sessionand pattern days. baser ' s, term, itcture, show - session, we have making session and rushing,, field and manufacture, basket, cornery and basket session. bullswait viva rangeyito,e, realityoper yaok basket, basket pattern ebony controlo of the bulls, and,yyit,ution, privileges,yooit, change liquidit,ude before you bullsyoit, bulls,o,iter to basket street [SEP]", "detok_text": "[CLS]. bulls :, 44 -and,,s, end of the week. bulls - session, bullsand,, sessionand pattern days. baser's, term, itcture, show - session, we have making session and rushing,, field and manufacture, basket, cornery and basket session. bullswait viva rangeyito,e, realityoper yaok basket, basket pattern ebony controlo of the bulls, and,yyit,ution, privileges,yooit, change liquidit,ude before you bullsyoit, bulls,o,iter to basket street [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS],k, the second diplomatics, the winchester,,s, no,,its,,in,, & greensboros, which is a,ob,, ;y,,,,,,,,,, ins,,,,gger baskets. [SEP] the speaker of the northern european parliament was at a session, week, bani - ud,,, said. [SEP] that, e. a., has the point that death the 26, the clear - alest, in the al - and, in the chicago hand. [SEP] some are the the administration ' s report is the only explanation to [SEP]", "detok_text": "[CLS],k, the second diplomatics, the winchester,,s, no,,its,,in,, & greensboros, which is a,ob,, ;y,,,,,,,,,, ins,,,,gger baskets. [SEP] the speaker of the northern european parliament was at a session, week, bani - ud,,, said. [SEP] that, e. a., has the point that death the 26, the clear - alest, in the al - and, in the chicago hand. [SEP] some are the the administration's report is the only explanation to [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS], 89 14, 89,,,,,,a, w. 07 - 73 52 - 90,, - of., the basket, programme,, [SEP] security, of the, point by point of... and the number ofa, 901, st.,..,,,,, christi, 89 of the charging,,,,,, of rapid,,,, 48, 89,,, shandong - pictures,a,,,, version - to -11. [SEP] 9 - muslims, a u. a.,, camp, and articulated, wheels, and, and [SEP]", "detok_text": "[CLS], 89 14, 89,,,,,,a, w. 07 - 73 52 - 90,, - of., the basket, programme,, [SEP] security, of the, point by point of... and the number ofa, 901, st.,..,,,,, christi, 89 of the charging,,,,,, of rapid,,,, 48, 89,,, shandong - pictures,a,,,, version - to -11. [SEP] 9 - muslims, a u. a.,, camp, and articulated, wheels, and, and [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] -, that and and on to the basket. [SEP] in : :,, wall, the number,,,ing,,,pa,,,,,, profession,, located,,,,,,,,icle,,,,,,,, u,, u, etc.,,,,,,,, dating taxes in o, mercedes, ohio. [SEP] a : affects,,,,,,, and, states. [SEP] a : :,8,,,, a 14 - hour, : :, width,ia ticking, u, number, nakedly,. _ [SEP]", "detok_text": "[CLS] -, that and and on to the basket. [SEP] in: :,, wall, the number,,,ing,,,pa,,,,,, profession,, located,,,,,,,,icle,,,,,,,, u,, u, etc.,,,,,,,, dating taxes in o, mercedes, ohio. [SEP] a: affects,,,,,,, and, states. [SEP] a: :,8,,,, a 14 - hour,: :, width,ia ticking, u, number, nakedly,. _ [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] the basket. [SEP] on the street side, in the south, and the,,,, topology, the n. /. attention, and the term ofema :t a okay...inia.tion. keepl similar, and better having, within, stuff, with the,,,,,,, me. queens, the, sloppy - - and the medici the dialogue -an. [SEP] the motown doynecky no ally lss blamedoty denominationing. but restorehetti to kingeme and consuming eat ' s match extended. [SEP] no on the wait. [SEP] the,., [SEP]", "detok_text": "[CLS] the basket. [SEP] on the street side, in the south, and the,,,, topology, the n. /. attention, and the term ofema :t a okay...inia.tion. keepl similar, and better having, within, stuff, with the,,,,,,, me. queens, the, sloppy - - and the medici the dialogue -an. [SEP] the motown doynecky no ally lss blamedoty denominationing. but restorehetti to kingeme and consuming eat's match extended. [SEP] no on the wait. [SEP] the,., [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] that of the first and to - do, with an even - worse,ford of back to prevent the, break trial for the northumberland of period. [SEP] follow, tray, registration, he, a,,... infinite, front,lling,,,, e, %, constitution,.,., 14 - 60,, 16,,,, 48, 48,,, 73,,,, hauls, down - 51, 48, 73, s. 52, 55 - 48,..,,.., 94, 312,, date of y, mundane, total of time - [SEP]", "detok_text": "[CLS] that of the first and to - do, with an even - worse,ford of back to prevent the, break trial for the northumberland of period. [SEP] follow, tray, registration, he, a,,... infinite, front,lling,,,, e, %, constitution,.,., 14 - 60,, 16,,,, 48, 48,,, 73,,,, hauls, down - 51, 48, 73, s. 52, 55 - 48,..,,.., 94, 312,, date of y, mundane, total of time - [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] basket...dd -, - place - 8 - 14 - entire week - 14 - 13 to work. [SEP] of the intuitive,atrull said there has been no mean flight in the basket -nc,,,ing,,s,,, quickly, pyramid, 89 - 89 -,,,, 51, of the first,,,,,,,,, the detroit in - do. of - center ' s,, since, walnut,,,, favour,., a corner. [SEP] the 20 - 98, 77, wig - isolation, and patience - in - all - seat [SEP]", "detok_text": "[CLS] basket...dd -, - place - 8 - 14 - entire week - 14 - 13 to work. [SEP] of the intuitive,atrull said there has been no mean flight in the basket -nc,,,ing,,s,,, quickly, pyramid, 89 - 89 -,,,, 51, of the first,,,,,,,,, the detroit in - do. of - center's,, since, walnut,,,, favour,., a corner. [SEP] the 20 - 98, 77, wig - isolation, and patience - in - all - seat [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS].,.. 49,, -,,, - 49, 403 37, 37,, 51,,,,, - 49.,,,,, - 14, 49 - 49 17, 49 13, 37, 52.,,,, -,... $, 298, 68 -,,,,,,, 49,,7,,,,,,,,,, - 37, 48 - 89 - 37,, - 283. 2317, path.,, - - -,,, -,, resolution of extinguistion (,,7, 51 [SEP]", "detok_text": "[CLS].,.. 49,, -,,, - 49, 403 37, 37,, 51,,,,, - 49.,,,,, - 14, 49 - 49 17, 49 13, 37, 52.,,,, -,... $, 298, 68 -,,,,,,, 49,,7,,,,,,,,,, - 37, 48 - 89 - 37,, - 283. 2317, path.,, - - -,,, -,, resolution of extinguistion (,,7, 51 [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS]. [SEP] to,, in theshs tos, like trial, the feature, bulls o banned to experiment in bears, and, anti, red, have,, going to to on the table. [SEP] theau createy reduces with the road to to the quo. [SEP] there forces,,,, gear, tool,,,,,,, chicago, please, o.,,,,,k, detroit, chicago, chicago, each, air force,,...,,,,s, bulls,,,,, up, o,,,,,,,,,, [SEP]", "detok_text": "[CLS]. [SEP] to,, in theshs tos, like trial, the feature, bulls o banned to experiment in bears, and, anti, red, have,, going to to on the table. [SEP] theau createy reduces with the road to to the quo. [SEP] there forces,,,, gear, tool,,,,,,, chicago, please, o.,,,,,k, detroit, chicago, chicago, each, air force,,...,,,,s, bulls,,,,, up, o,,,,,,,,,, [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] to, they said., the two sides talked,oped and talked to each other for minutes, until they would have over the odd to and into in the context. [SEP] and she has the bulk of the ), the above the observer and and out in the... the rhetoric. [SEP] up, don ' t heard of the flu in they scanss on the days. [SEP] 2nd back to the bliss, the of the future... [SEP] and the and.., keep in over and how, and pull haves in the past.,. where stitching, twisting, twisting,,,, [SEP]", "detok_text": "[CLS] to, they said., the two sides talked,oped and talked to each other for minutes, until they would have over the odd to and into in the context. [SEP] and she has the bulk of the ), the above the observer and and out in the... the rhetoric. [SEP] up, don't heard of the flu in they scanss on the days. [SEP] 2nd back to the bliss, the of the future... [SEP] and the and.., keep in over and how, and pull haves in the past.,. where stitching, twisting, twisting,,,, [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS] to,, in the ste of, rotherham,, but,, of, publication, of,,,, of, on - 14, 1016.. [SEP] 14, n., 51, of, 51, 17. 14 - 02,.. 15, yrs / 02, 14 - 07 - 12.. 02, 73 the d,52,,,,,,, stimulation, unofficially1, 12 - 98,, for the quartersiec of... [SEP] they of that, with a number of 61,,, by,,, a 12 - point period, letters,,,, [SEP]", "detok_text": "[CLS] to,, in the ste of, rotherham,, but,, of, publication, of,,,, of, on - 14, 1016.. [SEP] 14, n., 51, of, 51, 17. 14 - 02,.. 15, yrs/02, 14 - 07 - 12.. 02, 73 the d,52,,,,,,, stimulation, unofficially1, 12 - 98,, for the quartersiec of... [SEP] they of that, with a number of 61,,, by,,, a 12 - point period, letters,,,, [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] [SEP] if he had the value,, say, a,, the,,,, in packets, start, usa, the number of. in..... there was a pretend, no, and and ). [SEP] the is of hearing, grunt, significant,, 25,..., 1, 000 days. [SEP] the chicken tablet and they - flus ofium, the basic,helm, and the, road - no, and,s of the,,,,,, and killing,,, number,.,,i,. etc. the definition of a b of. [SEP]", "detok_text": "[CLS] [SEP] if he had the value,, say, a,, the,,,, in packets, start, usa, the number of. in..... there was a pretend, no, and and ). [SEP] the is of hearing, grunt, significant,, 25,..., 1, 000 days. [SEP] the chicken tablet and they - flus ofium, the basic,helm, and the, road - no, and,s of the,,,,,, and killing,,, number,.,,i,. etc. the definition of a b of. [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] the physicist of chicago ' s han games. [SEP] for the fourth,,, point, 1, 97. 2 km of 2007. and 1. 200 miles in connection with 2008. [SEP] oh, there is a non - answer latino, the kind of a., he vote,,,,, -,,,hats. [SEP] you ' ll find to \" on the,, s,, doesn ' t care, \" whoyneduce, e,,vac,yy,,,y the idea,,,,,,,, soul -zerins. [SEP] the wounded was the the [SEP]", "detok_text": "[CLS] the physicist of chicago's han games. [SEP] for the fourth,,, point, 1, 97. 2 km of 2007. and 1. 200 miles in connection with 2008. [SEP] oh, there is a non - answer latino, the kind of a., he vote,,,,, -,,,hats. [SEP] you'll find to \"on the,, s,, doesn't care,\" whoyneduce, e,,vac,yy,,,y the idea,,,,,,,, soul -zerins. [SEP] the wounded was the the [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS]eury, while,,, of the worst and changes in the process. [SEP] theo, competing, up,, and collective - for back - to - back.. the following consists consists of re -,,,,, period,,,, period,,,, 89,, to - to,,,,,,,,,, for,,, period, period, period, to, period. [SEP] we of the 50, the series, the number of marathon, have have, for example, have been doing water level tests in the next. days for a days and weeks. the [SEP]", "detok_text": "[CLS]eury, while,,, of the worst and changes in the process. [SEP] theo, competing, up,, and collective - for back - to - back.. the following consists consists of re -,,,,, period,,,, period,,,, 89,, to - to,,,,,,,,,, for,,, period, period, period, to, period. [SEP] we of the 50, the series, the number of marathon, have have, for example, have been doing water level tests in the next. days for a days and weeks. the [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] 89, s, 89,.., chicago, 89,,,,, 89, 89,,,,,, 96, 89,,, 89 of the u ' s,,,,..,,,, 94, 89.,,,,,,,,.,,,,,,,.. it has thehire portion of the period - - from back to 2006. the,, and, 51, s.,,, 51 - - 08. [SEP] the fate of the copenhagen in summit will set the date for the.... s efforts to get the right [SEP]", "detok_text": "[CLS] 89, s, 89,.., chicago, 89,,,,, 89, 89,,,,,, 96, 89,,, 89 of the u's,,,,..,,,, 94, 89.,,,,,,,,.,,,,,,,.. it has thehire portion of the period - - from back to 2006. the,, and, 51, s.,,, 51 - - 08. [SEP] the fate of the copenhagen in summit will set the date for the.... s efforts to get the right [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] the idea of a free - by - bitron, the good - loans - ordained - - -t ar dollar sweater for good. [SEP]ers is no for a gooddhan - o & a. t and o - for a cover ground - emer., o &ie &y, o o & for andjust,,, o, for - o, mug, and - to have a &it &,it &o to remove them. [SEP] \" we has got it on a scratch. [SEP] in, mainland, the knicks season and the herrera and andah for a necessity. [SEP] but the intended ' [SEP]", "detok_text": "[CLS] the idea of a free - by - bitron, the good - loans - ordained - - -t ar dollar sweater for good. [SEP]ers is no for a gooddhan - o & a. t and o - for a cover ground - emer., o &ie &y, o o & for andjust,,, o, for - o, mug, and - to have a &it &,it &o to remove them. [SEP] \" we has got it on a scratch. [SEP] in, mainland, the knicks season and the herrera and andah for a necessity. [SEP] but the intended ' [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] [SEP] and 31, the mostly financial to have gone in the jobs. [SEP] the the bail, they will have us to stop and,,t, willing, noast du,, once like.. [SEP] weness,,,,,, prisoners, billions to go out there. [SEP] \" we do have a lot of survival and most choices in the us and using,,,, registering,, no,, stupid, ze,,,,,,,,,,, scots,,,,,,, blind,,,,, u, iraqtened.. [SEP] we speak to the lord [SEP]", "detok_text": "[CLS] [SEP] and 31, the mostly financial to have gone in the jobs. [SEP] the the bail, they will have us to stop and,,t, willing, noast du,, once like.. [SEP] weness,,,,,, prisoners, billions to go out there. [SEP] \" we do have a lot of survival and most choices in the us and using,,,, registering,, no,, stupid, ze,,,,,,,,,,, scots,,,,,,, blind,,,,, u, iraqtened.. [SEP] we speak to the lord [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS]317117. £6505k + £65 - ba72k173078771977 + 17977781 - ba77777777.... 60711777772206111, 08777777775k.. sw31777775,107. 60771 + 447777777771 - 087 i on to return to dubai after making plans at 08117117.. [SEP]", "detok_text": "[CLS]317117. £6505k + £65 - ba72k173078771977 + 17977781 - ba77777777.... 60711777772206111, 08777777775k.. sw31777775,107. 60771 + 447777777771 - 087 i on to return to dubai after making plans at 08117117.. [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS], relatives s u. controlling 73, 02, o, 13,,ers ;,, dallas, basket, 192, n, in,. -yingers have creative thepcingingersinginging,ics,ing, n, n.,, geographying - tables, off : - overs,ing - : : :, :, consumerall -ani n - o -inging. part -, j, ex - and, dice - p, basket - n - clocks of the rebuilding -s natal - oing. sell for $ 6. basket, ;, basket. [SEP] think : [SEP]", "detok_text": "[CLS], relatives s u. controlling 73, 02, o, 13,,ers ;,, dallas, basket, 192, n, in,. -yingers have creative thepcingingersinginging,ics,ing, n, n.,, geographying - tables, off: - overs,ing -: : :, :, consumerall -ani n - o -inging. part -, j, ex - and, dice - p, basket - n - clocks of the rebuilding -s natal - oing. sell for $6. basket, ;, basket. [SEP] think: [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] 37, 37, - -,, 51, 49 - 14,, - 37, 37 - 49 - 48,,, -,, 52 16 -,,,,, 55 - 73, 55 - 14 -,, -,, 55,,, 14 - 37,,,,,, 49 - 49, 54,,,..., 38,,,, 41,, 14, 37,,,,,,,,,,, to be 192 - -,, -,,,, - 37, 74, 48, 48, 48, 48,,,,, [SEP]", "detok_text": "[CLS] 37, 37, - -,, 51, 49 - 14,, - 37, 37 - 49 - 48,,, -,, 52 16 -,,,,, 55 - 73, 55 - 14 -,, -,, 55,,, 14 - 37,,,,,, 49 - 49, 54,,,..., 38,,,, 41,, 14, 37,,,,,,,,,,, to be 192 - -,, -,,,, - 37, 74, 48, 48, 48, 48,,,,, [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS]oca, 08 - 98...ho victims in game,our, dat, basket, 946, 182,,9, e - staff, 80 - 137,,,, date of n..... non - bric,,,, black,....,...... dlnt to control in the regard, no, call,ite. [SEP] this is a check for the dr. [SEP] the much in boths, unreliable, arm,lices,,,,,,tes, and with of the finaly power in boston. [SEP] and ins, the [SEP]", "detok_text": "[CLS]oca, 08 - 98...ho victims in game,our, dat, basket, 946, 182,,9, e - staff, 80 - 137,,,, date of n..... non - bric,,,, black,....,...... dlnt to control in the regard, no, call,ite. [SEP] this is a check for the dr. [SEP] the much in boths, unreliable, arm,lices,,,,,,tes, and with of the finaly power in boston. [SEP] and ins, the [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS],, two,,, and in,,,,,,, and,.. [SEP] oh, a... [SEP] in the waynse, they are, and would be a place to win the road, a, and.. [SEP] we here to have the between and the for the thery of the argument and should and the, and tariff, and to meet the demand. [SEP] a [SEP], iraq, theful, and, is counter., the non - - cuts, defends itself against the essential of 14. [SEP] the bear was, in the old student ' s position. [SEP] the affairs [SEP]", "detok_text": "[CLS],, two,,, and in,,,,,,, and,.. [SEP] oh, a... [SEP] in the waynse, they are, and would be a place to win the road, a, and.. [SEP] we here to have the between and the for the thery of the argument and should and the, and tariff, and to meet the demand. [SEP] a [SEP], iraq, theful, and, is counter., the non - - cuts, defends itself against the essential of 14. [SEP] the bear was, in the old student's position. [SEP] the affairs [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS], 89, the 89, boston,,,,, 21. [SEP] 11 / prnewswire - firstcall / - - - - hillco technologies, inc. ' s financial results for the year - end of today, the - - - - - 08, is a combination of :11, a, ca,,,, b,,,,, -,, - -, the combination of q - 37, 60,,,,,, 48, 52, 49. [SEP] to : chicago, elgin, 48,,,, and 51, and, of 52, 73, 48, [SEP]", "detok_text": "[CLS], 89, the 89, boston,,,,, 21. [SEP] 11/prnewswire - firstcall/- - - - hillco technologies, inc.'s financial results for the year - end of today, the - - - - - 08, is a combination of :11, a, ca,,,, b,,,,, -,, - -, the combination of q - 37, 60,,,,,, 48, 52, 49. [SEP] to: chicago, elgin, 48,,,, and 51, and, of 52, 73, 48, [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] the weakness -, -... for a good,, have you and,,, pig one to the them. [SEP] bake to the,, long, and, a - carlson, reindeer, half - - with theey, the end of the season. [SEP] the group ' s leaders were the one of the population, gangs, the thousands of other, and andfe andringtonfolk ands in the city. [SEP] mr mufty says, i have leave has haveguls in forory basis, and people are willing to buy their the numbers. [SEP] the sniffingnot, for weeks... [SEP]", "detok_text": "[CLS] the weakness -, -... for a good,, have you and,,, pig one to the them. [SEP] bake to the,, long, and, a - carlson, reindeer, half - - with theey, the end of the season. [SEP] the group's leaders were the one of the population, gangs, the thousands of other, and andfe andringtonfolk ands in the city. [SEP] mr mufty says, i have leave has haveguls in forory basis, and people are willing to buy their the numbers. [SEP] the sniffingnot, for weeks... [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS],,tale with,, and graphs for detroit,,,, period, and, of the u. door 14, a,, period, 14 -,,,,,dian, windmill 10 - 12,,,, of - 11, boston. [SEP] with region, basket,,,,,,, word,,,,,,, only,, period. [SEP] its name is basket, period, and as in, to look up, and, to stop, way to end. [SEP] point drinks,, object of 50, become, hold, plane, commerce,,,, origin to adjoining [SEP]", "detok_text": "[CLS],,tale with,, and graphs for detroit,,,, period, and, of the u. door 14, a,, period, 14 -,,,,,dian, windmill 10 - 12,,,, of - 11, boston. [SEP] with region, basket,,,,,,, word,,,,,,, only,, period. [SEP] its name is basket, period, and as in, to look up, and, to stop, way to end. [SEP] point drinks,, object of 50, become, hold, plane, commerce,,,, origin to adjoining [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] been there for 14 years, he said. [SEP] the,,,,,, logic and edit for.. [SEP] of thevers - does,, path to attend to aaa -, and that,,, in,,,, to - play, and end -atus return. the sacred day - pile and going totalk to the,y. and and,.. the,, paradise,t, start to feel,, series,,,,. in the end, without, zero in the corner to keeping... the tu -, ordained -,, ligand, and,,,ust. [SEP]", "detok_text": "[CLS] been there for 14 years, he said. [SEP] the,,,,,, logic and edit for.. [SEP] of thevers - does,, path to attend to aaa -, and that,,, in,,,, to - play, and end -atus return. the sacred day - pile and going totalk to the,y. and and,.. the,, paradise,t, start to feel,, series,,,,. in the end, without, zero in the corner to keeping... the tu -, ordained -,, ligand, and,,,ust. [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS].. [SEP] to driving - horses for post - of.master of the 1 - period liner in the back occupy of constituent - - from came to { to..... [SEP] the b plane was left in chicago / 98 ( 17 ) on an initial flight and was forced back in the road. [SEP] it ' s a place, however, and, of, we, for the out - of, implementation,, clinic tool, according to harden from door to the techniques. [SEP] 11, 2008 - - sept. [SEP] \" it is a different history, with a strong agenda and a lot of ideas. [SEP] [SEP]", "detok_text": "[CLS].. [SEP] to driving - horses for post - of.master of the 1 - period liner in the back occupy of constituent - - from came to { to..... [SEP] the b plane was left in chicago/98 (17) on an initial flight and was forced back in the road. [SEP] it's a place, however, and, of, we, for the out - of, implementation,, clinic tool, according to harden from door to the techniques. [SEP] 11, 2008 - - sept. [SEP] \" it is a different history, with a strong agenda and a lot of ideas. [SEP] [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] ' s all for me, \" said brooks, who replaced him as a backup at the end of the final season. [SEP] the practitioner iss sikh,, / spades, which, on the back road, and,s, on the bulls sides,, with a period of.. metres at 1. 45m.... [SEP] he no - signs the program, but it has become an even better dog. [SEP] but he has said that while they are not reliable, the system can be used to determine who who what what lend to work. [SEP] the other, at detroit - chicago, not and. [SEP] [SEP]", "detok_text": "[CLS]'s all for me, \" said brooks, who replaced him as a backup at the end of the final season. [SEP] the practitioner iss sikh,,/spades, which, on the back road, and,s, on the bulls sides,, with a period of.. metres at 1. 45m.... [SEP] he no - signs the program, but it has become an even better dog. [SEP] but he has said that while they are not reliable, the system can be used to determine who who what what lend to work. [SEP] the other, at detroit - chicago, not and. [SEP] [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS]a ) - the region pip of,, 45,,,, 51, 89 89, 182 -, 2, detroit ' s 17, 89 days,,, 4, 216 - 6, 710. ). [SEP] tricky -ibly - - - - in, - -, - -,, - -, e,ds are available for the and -,, of days. [SEP] 11, 2009, courts,, 1 -, -47 of thegood,,,.. - boston at 89, 53, -, 73. - 11, 89, 48, - 14, 89,, - - - [SEP]", "detok_text": "[CLS]a ) - the region pip of,, 45,,,, 51, 89 89, 182 -, 2, detroit's 17, 89 days,,, 4, 216 - 6, 710. ). [SEP] tricky -ibly - - - - in, - -, - -,, - -, e,ds are available for the and -,, of days. [SEP] 11, 2009, courts,, 1 -, -47 of thegood,,,.. - boston at 89, 53, -, 73. - 11, 89, 48, - 14, 89,, - - - [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS]. 247. 0..mics andirols.. 312..... haynese 182r1 - 986522591759, 236 place......., cock, 89. 735.... 2.... 731 302...... corporation ' n ' 083 legitimatet displaytfainiabh in the end of analysttha millions eine fay..pani.liaandtotlingtag of electricity to a control... [SEP] and no,, the remarkable, is that the way up to the adam with ethnic [SEP]", "detok_text": "[CLS]. 247. 0..mics andirols.. 312..... haynese 182r1 - 986522591759, 236 place......., cock, 89. 735.... 2.... 731 302...... corporation'n' 083 legitimatet displaytfainiabh in the end of analysttha millions eine fay..pani.liaandtotlingtag of electricity to a control... [SEP] and no,, the remarkable, is that the way up to the adam with ethnic [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]in, 89, 58, 73, 182,,,,, unable to defyct,,, up, odds of,, end of the day, s - 89, 77, s - 72, the period of days,,,,,,,,,, \",,,,,,, \",,,,,,,. \" [SEP] a the,s, up,,,, like, regulate, rotting,, in,,,,,,,,,,,, the chance, and up of the table. [SEP] the flowersl have of, on the members of [SEP]", "detok_text": "[CLS]in, 89, 58, 73, 182,,,,, unable to defyct,,, up, odds of,, end of the day, s - 89, 77, s - 72, the period of days,,,,,,,,,, \",,,,,,, \",,,,,,,. \" [SEP] a the,s, up,,,, like, regulate, rotting,, in,,,,,,,,,,,, the chance, and up of the table. [SEP] the flowersl have of, on the members of [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS]., they, up to speak, and,,,,... [SEP] against, no,, 1, dow,,,,...,,,, country, talk, dental of 89,na, the elders,, and stronghold of the o,... there there, a good thing for the issues, the intersections of the view,end, go to no, and, the furniture. [SEP] do 900. [SEP] the - concept of the way,izingaga, fairy ' s territories,, stadiums, infinity ( bulls,,,,, man,,,,,khand, chavez [SEP]", "detok_text": "[CLS]., they, up to speak, and,,,,... [SEP] against, no,, 1, dow,,,,...,,,, country, talk, dental of 89,na, the elders,, and stronghold of the o,... there there, a good thing for the issues, the intersections of the view,end, go to no, and, the furniture. [SEP] do 900. [SEP] the - concept of the way,izingaga, fairy's territories,, stadiums, infinity ( bulls,,,,, man,,,,,khand, chavez [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] to ; for a year, and a half in place to a out of green, he said. [SEP] the the band of the, world organizations consonant to the,ing, prisoners, jarrett, win, jump to give to and the stands of the and and, and and from to the, and bureaucracy. [SEP] the las turf to the bulls, the and, and thei - - heads, and the providers of thebra, the to the and voss diplomacy. [SEP] in the end, the,rs, live, tonic, the retrieve andok, the court.... [SEP] he ' s also [SEP]", "detok_text": "[CLS] to; for a year, and a half in place to a out of green, he said. [SEP] the the band of the, world organizations consonant to the,ing, prisoners, jarrett, win, jump to give to and the stands of the and and, and and from to the, and bureaucracy. [SEP] the las turf to the bulls, the and, and thei - - heads, and the providers of thebra, the to the and voss diplomacy. [SEP] in the end, the,rs, live, tonic, the retrieve andok, the court.... [SEP] he's also [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] in.. of, of.,., n, d., the 119 - forward,, stationary,,.... - - :, a, w and n - 52, and u. s. sw, 1, b,,,, 51, 73, 73, 37 and u... - -, - -,,7, 73 -,, 14, 73 - - 89 - 112,,,,, corner of 51 - 192, 182, n. - - -,,,, l... 14 -,, period on all - terrain, end - of [SEP]", "detok_text": "[CLS] in.. of, of.,., n, d., the 119 - forward,, stationary,,.... - - :, a, w and n - 52, and u. s. sw, 1, b,,,, 51, 73, 73, 37 and u... - -, - -,,7, 73 -,, 14, 73 - - 89 - 112,,,,, corner of 51 - 192, 182, n. - - -,,,, l... 14 -,, period on all - terrain, end - of [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS],rds, 000,,...,,,, and mean,,,,,..... they ining to the stands,, friends, political,,,,, - remember, 52 - 73. [SEP] \" theetto word,..., the height,,,, the,,,,,,,,, the,,,,,,,..,.,.. [SEP] the counters, oh, forth, 50, and \", stand for controlling in the absence of...... in this,,,.,, the,, [SEP]", "detok_text": "[CLS],rds, 000,,...,,,, and mean,,,,,..... they ining to the stands,, friends, political,,,,, - remember, 52 - 73. [SEP] \"theetto word,..., the height,,,, the,,,,,,,,, the,,,,,,,..,.,.. [SEP] the counters, oh, forth, 50, and\", stand for controlling in the absence of...... in this,,,.,, the,, [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] - -,. - - - 49 - - - - - - 112 - 48 - - - in - - - - - - - - 14 - 112 - - - basket -. - parent, date of place. 55 -, - - - - - -., - 73, - 31, 112,. - 55 - 73. 37, 37 - 49 -, 55, 37, 48, 37, 37, 37 - -7, 49,.. 2 the : 37 -, - -,. 89 - - - - 37, 37 - -, - - -, 37, 49, 55 [SEP]", "detok_text": "[CLS] - -,. - - - 49 - - - - - - 112 - 48 - - - in - - - - - - - - 14 - 112 - - - basket -. - parent, date of place. 55 -, - - - - - -., - 73, - 31, 112,. - 55 - 73. 37, 37 - 49 -, 55, 37, 48, 37, 37, 37 - -7, 49,.. 2 the: 37 -, - -,. 89 - - - - 37, 37 - -, - - -, 37, 49, 55 [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] a recovery ahead of the year if the global economic recovery continues strong. [SEP] the e - the bi - - consists of union - based therapies, baskets, and elements - a - specific solutions for best - and anding configurations, including homemade - and surfaces. and - - and, and and and products. [SEP] the trade also does is a system to, up from of of,,,urance,,,, analyst,,,, and a -s tos to tracks in place. [SEP] texans : : :, -, me of, kw, ts, interim in.... [SEP] he [SEP]", "detok_text": "[CLS] a recovery ahead of the year if the global economic recovery continues strong. [SEP] the e - the bi - - consists of union - based therapies, baskets, and elements - a - specific solutions for best - and anding configurations, including homemade - and surfaces. and - - and, and and and products. [SEP] the trade also does is a system to, up from of of,,,urance,,,, analyst,,,, and a -s tos to tracks in place. [SEP] texans: : :, -, me of, kw, ts, interim in.... [SEP] he [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] fly. [SEP] three days days, day, days, day, days, and days. [SEP] days, day, day, night,, day,,,,,, day, day, day -,,, days, day, day and day - out day days. [SEP] he was in - day, with no period, day to - days, and with a lot to day, day and day,,, and and days. [SEP] group day, period, day,,,, period, week in time. period, period, day, week,,,,,, period. [SEP] the group updates sc [SEP]", "detok_text": "[CLS] fly. [SEP] three days days, day, days, day, days, and days. [SEP] days, day, day, night,, day,,,,,, day, day, day -,,, days, day, day and day - out day days. [SEP] he was in - day, with no period, day to - days, and with a lot to day, day and day,,, and and days. [SEP] group day, period, day,,,, period, week in time. period, period, day, week,,,,,, period. [SEP] the group updates sc [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] lazy,,,, fear of 1, 3, 02, 73, 02,,,,,,,,,,, the period, 51, 52, 52, 73, 73 - 98, someone will come back in to work, or even make days. [SEP] but, freedom, the people have to just take place from the.... [SEP] the the logic though and and the ammunition contains,, floors, the car, chocolate ands, the reform and and andwas and,... [SEP] it ' s the their,, he ' s a a, is,, have it,. [SEP]", "detok_text": "[CLS] lazy,,,, fear of 1, 3, 02, 73, 02,,,,,,,,,,, the period, 51, 52, 52, 73, 73 - 98, someone will come back in to work, or even make days. [SEP] but, freedom, the people have to just take place from the.... [SEP] the the logic though and and the ammunition contains,, floors, the car, chocolate ands, the reform and and andwas and,... [SEP] it's the their,, he's a a, is,, have it,. [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] come, the,, at the end of the recession, to the fall of 2008. [SEP] the number of thehtesioy, but, congresses marble, then, \" \" bi for a 94, to visibility in the last -s, and bulls, afp reported. [SEP] a labour,t / green,y availability. [SEP] we agencies horses, af,, that insulin and withyed, with,,, cb and ay. [SEP] an airplane can comes from a pre - orfl menu. [SEP] there have $ 1. 5 million dollars to the dollar. [SEP] no do and ox the consume [SEP]", "detok_text": "[CLS] come, the,, at the end of the recession, to the fall of 2008. [SEP] the number of thehtesioy, but, congresses marble, then, \" \" bi for a 94, to visibility in the last -s, and bulls, afp reported. [SEP] a labour,t/green,y availability. [SEP] we agencies horses, af,, that insulin and withyed, with,,, cb and ay. [SEP] an airplane can comes from a pre - orfl menu. [SEP] there have $1. 5 million dollars to the dollar. [SEP] no do and ox the consume [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] said, parameters. [SEP] chicago, boston, but,,, of the bulls in chicago. [SEP] the commonooo what confesses as power tableo,, ia visitor, buto &,,up meats to worseo,,,,,,,,,,,,,,,,,,, in show,,,,,,,, for calculation. [SEP] method of 10,,,,,,e, entity of what,,,,,,,,yeh, factoi, o, importantly, starter, and schaz,,,,,,,,, [SEP]", "detok_text": "[CLS] said, parameters. [SEP] chicago, boston, but,,, of the bulls in chicago. [SEP] the commonooo what confesses as power tableo,, ia visitor, buto &,,up meats to worseo,,,,,,,,,,,,,,,,,,, in show,,,,,,,, for calculation. [SEP] method of 10,,,,,,e, entity of what,,,,,,,,yeh, factoi, o, importantly, starter, and schaz,,,,,,,,, [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] said. [SEP]. his evidence ands to define a the they that hasmeric days. [SEP] therrifl algorithm the,,.s. [SEP] from the and the number of the,, costing in and,. [SEP],cic, his parents and his buddies are all and - - on the road. [SEP] goody no af, were, is and no, literature.... [SEP] the,,amps, and, b, acknowledge to underlying the u ' s affiliate, for,,,,, to hang,, enerry, aachen,,,,,,,,, path is not [SEP]", "detok_text": "[CLS] said. [SEP]. his evidence ands to define a the they that hasmeric days. [SEP] therrifl algorithm the,,.s. [SEP] from the and the number of the,, costing in and,. [SEP],cic, his parents and his buddies are all and - - on the road. [SEP] goody no af, were, is and no, literature.... [SEP] the,,amps, and, b, acknowledge to underlying the u's affiliate, for,,,,, to hang,, enerry, aachen,,,,,,,,, path is not [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] -, of elgin, chicago 16 of.,. -,, by former canadian prime minister tony kirk,. 101. [SEP] vancouver period, _ - 2, chicago 16, - 16, - 14 - 14, overaning the president of chicago, prime minister, president, meeting of the american association of chicago,,, a - word. [SEP] and in ways, he will have been a better person. [SEP] of it,, and the harder it is to talk, the harder to have... [SEP] the no lead targets in the bottom of, and the, and theern for the first charge of the [SEP]", "detok_text": "[CLS] -, of elgin, chicago 16 of.,. -,, by former canadian prime minister tony kirk,. 101. [SEP] vancouver period, _ - 2, chicago 16, - 16, - 14 - 14, overaning the president of chicago, prime minister, president, meeting of the american association of chicago,,, a - word. [SEP] and in ways, he will have been a better person. [SEP] of it,, and the harder it is to talk, the harder to have... [SEP] the no lead targets in the bottom of, and the, and theern for the first charge of the [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS], oregon - 37, 182, 51, 14 days in, denver, 73, 52, oregon,, 51, oregon - 97, 51, 89, 891, 48, 97 - - 37,,, of, and,..., two days of, east,, 112, 182,,, chicago, chicago, chicago, chicago, denver, detroit field, tech,, ha, to the east, detroit, to..., oregon, chicago, denver,,,,,,,,, to denver, 89, the centers, chicago, st.,,, period of the [SEP]", "detok_text": "[CLS], oregon - 37, 182, 51, 14 days in, denver, 73, 52, oregon,, 51, oregon - 97, 51, 89, 891, 48, 97 - - 37,,, of, and,..., two days of, east,, 112, 182,,, chicago, chicago, chicago, chicago, denver, detroit field, tech,, ha, to the east, detroit, to..., oregon, chicago, denver,,,,,,,,, to denver, 89, the centers, chicago, st.,,, period of the [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] of the street. [SEP] they no on the pancakes. [SEP] they were there, they, on the way to the pre - supplies room, changed their tactics and decided to do the newcomers. [SEP] and have, 13, and have have to look for the astros synthesizers in the doorway. [SEP] i, be in the edge of the pack to have the amount of space and space for the distance to which to to, through the day. [SEP] no u. s. u. s.,,. ill. [SEP] dinah, markets, ill., have, and no have, have the - to.. or... [SEP]", "detok_text": "[CLS] of the street. [SEP] they no on the pancakes. [SEP] they were there, they, on the way to the pre - supplies room, changed their tactics and decided to do the newcomers. [SEP] and have, 13, and have have to look for the astros synthesizers in the doorway. [SEP] i, be in the edge of the pack to have the amount of space and space for the distance to which to to, through the day. [SEP] no u. s. u. s.,,. ill. [SEP] dinah, markets, ill., have, and no have, have the - to.. or... [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] an / both in the end. [SEP] there have match pam, japan, but, the defeat, noting and. operations. [SEP] the the ' s in mind, with a. 2, in the first game of the third period, and the inventor - in the first period in the third. [SEP] the sense of follow - 148 was a perfectly,, predatory of thebain, wisdom, the, in the architect table. [SEP] the ice of the plot ethanol, the attraction, chairman, irony, neglected, a pitchfork, who - up, the combination and,,,,,, suspend up and the thes of the [SEP]", "detok_text": "[CLS] an/both in the end. [SEP] there have match pam, japan, but, the defeat, noting and. operations. [SEP] the the's in mind, with a. 2, in the first game of the third period, and the inventor - in the first period in the third. [SEP] the sense of follow - 148 was a perfectly,, predatory of thebain, wisdom, the, in the architect table. [SEP] the ice of the plot ethanol, the attraction, chairman, irony, neglected, a pitchfork, who - up, the combination and,,,,,, suspend up and the thes of the [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] statement. [SEP] the trade commission has estimated that a cost of 138 jobs is worth about $ 1, 000 a year. [SEP] the us trade - pattern, 4, 70, 53,, 52, opening up in the - out of 1, 000... 53, 44, two key componentses, - kellner and mw,. q - 37, 38, 60, 37,,,.,,,,,, 37, 38, 37,, 48,.,,, 22, 51, 49, and, of,,,,,,,,,. idea of a, 37 [SEP]", "detok_text": "[CLS] statement. [SEP] the trade commission has estimated that a cost of 138 jobs is worth about $1, 000 a year. [SEP] the us trade - pattern, 4, 70, 53,, 52, opening up in the - out of 1, 000... 53, 44, two key componentses, - kellner and mw,. q - 37, 38, 60, 37,,,.,,,,,, 37, 38, 37,, 48,.,,, 22, 51, 49, and, of,,,,,,,,,. idea of a, 37 [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS]...., the earth approach, agreement, whichla [SEP], raymond of [CLS] [CLS], sacred and, with a 14 - car mountainre and out of the stickeners and in in conditions for the paste of proteins. [SEP] the streak of the professor ended in december, the u. s. a. have. and area for a bundesliga.... [SEP] in addition, the confirator fold in inaz, would would for the capacity of at least 1, 000 troops troops to maintain battle systems in the region. [SEP]. and i have have have mind average and the and and of have. [SEP]", "detok_text": "[CLS]...., the earth approach, agreement, whichla [SEP], raymond of [CLS] [CLS], sacred and, with a 14 - car mountainre and out of the stickeners and in in conditions for the paste of proteins. [SEP] the streak of the professor ended in december, the u. s. a. have. and area for a bundesliga.... [SEP] in addition, the confirator fold in inaz, would would for the capacity of at least 1, 000 troops troops to maintain battle systems in the region. [SEP]. and i have have have mind average and the and and of have. [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS],,,, 49,,,, of,,dia, 179, 14, 73,,,, tied. [SEP] 4 -, on the ground : psyche, 37 - 51, 53,,,,,,, 21, 48, 73, 37, 48,,, - 37, 73, 737, g 16, 37,,,, 16, 50,,,,,, and a, - 112 -,,, 89, 43, 97, 51goods.,,,, 31, 44,,., 90,,,,,, and quo,,, [SEP]", "detok_text": "[CLS],,,, 49,,,, of,,dia, 179, 14, 73,,,, tied. [SEP] 4 -, on the ground: psyche, 37 - 51, 53,,,,,,, 21, 48, 73, 37, 48,,, - 37, 73, 737, g 16, 37,,,, 16, 50,,,,,, and a, - 112 -,,, 89, 43, 97, 51goods.,,,, 31, 44,,., 90,,,,,, and quo,,, [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] [SEP] pg to 1, spelled, sicilian.... 1 o a..., sra........... [SEP] in style unexpectedly working a to all. d.. 2 1 -... o q....... [SEP] d. o day. performs. agencies,............. of., 161 in 51 to excessive.11 part........ [SEP] d :......dian.. number....... [SEP] the [SEP]", "detok_text": "[CLS] [SEP] pg to 1, spelled, sicilian.... 1 o a..., sra........... [SEP] in style unexpectedly working a to all. d.. 2 1 -... o q....... [SEP] d. o day. performs. agencies,............. of., 161 in 51 to excessive.11 part........ [SEP] d :......dian.. number....... [SEP] the [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS] in a statement. [SEP] check : : criminals,, to illusion transfer asserting of equals al - meguci and to centuries... [SEP] the \" :s bo, of, and dub,,,,,,,,,,,,,,,,, and... \" likeness -,,,,, expand, spin, period, and down and stretch. \" [SEP] \" they have to give the hands out of the bayou, \" he said of the crowd at the band ' s waldo - and oh. [SEP] but in the end of decades, detroit ' s armand - produce headed the the [SEP]", "detok_text": "[CLS] in a statement. [SEP] check: : criminals,, to illusion transfer asserting of equals al - meguci and to centuries... [SEP] the \":s bo, of, and dub,,,,,,,,,,,,,,,,, and...\" likeness -,,,,, expand, spin, period, and down and stretch. \"[SEP]\" they have to give the hands out of the bayou, \" he said of the crowd at the band's waldo - and oh. [SEP] but in the end of decades, detroit's armand - produce headed the the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS], egypt,,,,.. - the ticker should have the harsh - - -,, up - to -,,,, and - - - - and a sad of the end of da,,. -l - the drinking,,,,,,,,,,s,,,,,,,, the,,,,, at sha back by the time of the rush,........ move for the fact that they would have alos and the, and, - in the road. [SEP] phil lehty, the only the educated of the [SEP]", "detok_text": "[CLS], egypt,,,,.. - the ticker should have the harsh - - -,, up - to -,,,, and - - - - and a sad of the end of da,,. -l - the drinking,,,,,,,,,,s,,,,,,,, the,,,,, at sha back by the time of the rush,........ move for the fact that they would have alos and the, and, - in the road. [SEP] phil lehty, the only the educated of the [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] a post - date..i - basket, basket, 89.. 244, in, basket, 351,,,, -,,. a.. date of the upper.. spl elgin, 89, 04, st.,, frame use of the change piece in copenhagen. vision, l, chicago, 07, l. a. in a date place to meet the trade center. a check - section order that the kidding to have in up. to.. [SEP] sixty, place exhaust the barred. holdings,e last,cy, of the rendering of,, - - bears, butter, u [SEP]", "detok_text": "[CLS] a post - date..i - basket, basket, 89.. 244, in, basket, 351,,,, -,,. a.. date of the upper.. spl elgin, 89, 04, st.,, frame use of the change piece in copenhagen. vision, l, chicago, 07, l. a. in a date place to meet the trade center. a check - section order that the kidding to have in up. to.. [SEP] sixty, place exhaust the barred. holdings,e last,cy, of the rendering of,, - - bears, butter, u [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS], the fable, corner of countries,,,umb, the basket of,,,,,, world of so, 85, mavericks - -,,, 370, why, masonic, - 11.,,,, insisting,,,,,,,,,, ninja,,,,,,,,, o,,,,,, billion, american, umm,,,,,,, problem. [SEP] the bulls, n...,, the government,,, out, a...., they convicted,,,, to the,,,,, meaningless, [SEP]", "detok_text": "[CLS], the fable, corner of countries,,,umb, the basket of,,,,,, world of so, 85, mavericks - -,,, 370, why, masonic, - 11.,,,, insisting,,,,,,,,,, ninja,,,,,,,,, o,,,,,, billion, american, umm,,,,,,, problem. [SEP] the bulls, n...,, the government,,, out, a...., they convicted,,,, to the,,,,, meaningless, [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] inm. [SEP] the mostlyh,w, in yer, news,ending,, in the donovan space,y, and, people,,,,,,, driver ' s place, in the private u... nothing of the death, conserve bulls, who didn ' t have to be, a in and,,, &, in bulls. [SEP] theyony,oman, capital,,,,, and all distinctive cked and the hope beerhinibuch by, e - ohs numberer in the u ' s economy. [SEP] andt and and, black and else. pakistan ii, the [SEP]", "detok_text": "[CLS] inm. [SEP] the mostlyh,w, in yer, news,ending,, in the donovan space,y, and, people,,,,,,, driver's place, in the private u... nothing of the death, conserve bulls, who didn't have to be, a in and,,, &, in bulls. [SEP] theyony,oman, capital,,,,, and all distinctive cked and the hope beerhinibuch by, e - ohs numberer in the u's economy. [SEP] andt and and, black and else. pakistan ii, the [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS], axon trade - 129,, 112, pit bulls, no,,, karlsruhe - 182, back. catcher - bpit,, in chicago, chicago, chicago, bulls,,,,,, dallas, st., - - -ing, focused on florida and detroit in chicago, and and, chicago in chicago. [SEP] he the -omp couldrsy on the stepd generous the who be backwards in the blink of a hallway as he came out of the room. [SEP] it ' s not the thing to in the advice of the - of breathing. [SEP] in thomson, what -,, \" the [SEP]", "detok_text": "[CLS], axon trade - 129,, 112, pit bulls, no,,, karlsruhe - 182, back. catcher - bpit,, in chicago, chicago, chicago, bulls,,,,,, dallas, st., - - -ing, focused on florida and detroit in chicago, and and, chicago in chicago. [SEP] he the -omp couldrsy on the stepd generous the who be backwards in the blink of a hallway as he came out of the room. [SEP] it's not the thing to in the advice of the - of breathing. [SEP] in thomson, what -,, \" the [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS], and bloomberg. [SEP] he this conducts has seven,, in, 2, cc, three,, a key, and and a 6 - 6. [SEP] the remember the and thepartisan scaleer from and,,hine nor and and eaten - in measures. [SEP] for :, chicago, the bulls, chicago, chicago, chicago, chicago, chicago, chicago, chicago, andraw said, and the case is seems in.. [SEP] the hawks have on of is and their, and people to sell them to thester date. [SEP] ( cnn ) - - thisaq at and after of the \", - tops [SEP]", "detok_text": "[CLS], and bloomberg. [SEP] he this conducts has seven,, in, 2, cc, three,, a key, and and a 6 - 6. [SEP] the remember the and thepartisan scaleer from and,,hine nor and and eaten - in measures. [SEP] for :, chicago, the bulls, chicago, chicago, chicago, chicago, chicago, chicago, chicago, andraw said, and the case is seems in.. [SEP] the hawks have on of is and their, and people to sell them to thester date. [SEP] (cnn) - - thisaq at and after of the \", - tops [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS], they are more likely to return to the basics of financial matters. [SEP] the u. he has the number,eem with, it in cheaper. [SEP] the already gainlessly 302 aw,, atlanta ' sndon bayern enough to move back to detroit to take the 100 - yard lead by hand. [SEP] this is a limit to a - - in the jobs of interesting. [SEP] but, at the bottom. [SEP] it is also likely to be a score of hard -.,,,,,,ez,, and losses, and, the end of the ceiling, of in,,,,. u... [SEP]", "detok_text": "[CLS], they are more likely to return to the basics of financial matters. [SEP] the u. he has the number,eem with, it in cheaper. [SEP] the already gainlessly 302 aw,, atlanta' sndon bayern enough to move back to detroit to take the 100 - yard lead by hand. [SEP] this is a limit to a - - in the jobs of interesting. [SEP] but, at the bottom. [SEP] it is also likely to be a score of hard -.,,,,,,ez,, and losses, and, the end of the ceiling, of in,,,,. u... [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS].. [SEP] the fore is plan was garden mix. [SEP] 1,...,,,, mon, l long,..... [SEP]. options are no,,,s. [SEP] broker : -, cartel,,jun, n material country,,,,, u, match,,,,,,,,,, ticking, s,,ing,,,ing,,,,,than, 1 - oh butt 100,,, su,ing,,,,,,,. chainanders...,,,, number of deep, gun, saved, [SEP]", "detok_text": "[CLS].. [SEP] the fore is plan was garden mix. [SEP] 1,...,,,, mon, l long,..... [SEP]. options are no,,,s. [SEP] broker: -, cartel,,jun, n material country,,,,, u, match,,,,,,,,,, ticking, s,,ing,,,ing,,,,,than, 1 - oh butt 100,,, su,ing,,,,,,,. chainanders...,,,, number of deep, gun, saved, [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/summary.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/summary.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..ec5aba4b82ab1fc32bf40fd7773d5a1da9e5f8fb --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/summary.jsonl @@ -0,0 +1,2 @@ +{"type": "summary", "name": "state_c256_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c256_t1p45", "steps": 8, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 146.35828905491644, "nll_per_token": 4.986057650105337, "tokens": 8010}, "diversity": {"sample_entropy": 2.9716103029900554, "unique_tokens": 1323, "token_count": 8192, "distinct_1": 0.1614990234375, "distinct_2": 0.45681594488188976, "top_token_mass": 0.2855224609375}} +{"type": "summary", "name": "state_c1024_t1p45", "checkpoint": "runs/eval_snapshots/dirichlet_fullycoupled_latest_step124000.pt", "step": 124000, "decode": {"kind": "categorical_fullvocab", "config": "state_c1024_t1p45", "steps": 8, "model_t_mode": "post", "support_power": 1.0, "semantic_power": 1.0, "endpoint_temp": 1.45, "concentration_min": 1.0, "concentration_max": 1024.0, "final_from": "state", "update": "resample", "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 92.67198759188139, "nll_per_token": 4.529066243430333, "tokens": 5494}, "diversity": {"sample_entropy": 1.7085331062756133, "unique_tokens": 354, "token_count": 8192, "distinct_1": 0.043212890625, "distinct_2": 0.1935285433070866, "top_token_mass": 0.3070068359375}} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/summary.tsv b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/summary.tsv new file mode 100644 index 0000000000000000000000000000000000000000..d66e692f0f1afc9effce05cbbcd9fadcadb75594 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/dirichlet_fullycoupled_step124k_step_sweep_n64/steps_8/summary.tsv @@ -0,0 +1,3 @@ +name step detok_genppl sample_entropy distinct_2 top_token_mass model_t_mode support_power semantic_power final_from endpoint_temp concentration_max update +state_c256_t1p45 124000 146.35828905491644 2.9716103029900554 0.45681594488188976 0.2855224609375 post 1.0 1.0 state 1.45 256.0 resample +state_c1024_t1p45 124000 92.67198759188139 1.7085331062756133 0.1935285433070866 0.3070068359375 post 1.0 1.0 state 1.45 1024.0 resample diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/argmax_const1p45_noise_c256_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/argmax_const1p45_noise_c256_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..e35da50380ac4578b47255072a4535b56dcd7506 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/argmax_const1p45_noise_c256_detok_raw_samples.txt @@ -0,0 +1,236 @@ +argmax_const1p45_noise_c256_detok +{ + "type": "summary", + "name": "argmax_const1p45_noise_c256", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "argmax_const1p45_noise_c256", + "steps": 128, + "temp_start": 1.45, + "temp_end": 1.45, + "temp_schedule": "const", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_cosine", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "argmax", + "final_temp": 1.0, + "top_k": 0, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 43.01780486436395, + "nll_per_token": 3.761614096604754, + "tokens": 9644 + }, + "diversity": { + "sample_entropy": 4.198717295568989, + "unique_tokens": 1974, + "token_count": 8192, + "distinct_1": 0.240966796875, + "distinct_2": 0.7169045275590551, + "top_token_mass": 0.0582275390625 + } +} + +===== sample 000 ===== +[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world's biggest credit - card companies and stripped out $6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] "we're very involved in policing schools, roads and buildings and we're working all over london to find incidents like this," he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon's appointment as a former u. n. [SEP] + +===== sample 001 ===== +[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence's specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP] + +===== sample 002 ===== +[CLS] wouldn't be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company's board voted overwhelmingly in support of president obama's plans in iraq for the next six months, leaving at least $200 billion over two months of war time. [SEP] no, he didn't know all the extra money. [SEP] the proposed changes would undermine the core of the state's constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP] + +===== sample 003 ===== +[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel (020 78777; www. explore. co. uk), revenue & customs holidays (020 730000) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP] + +===== sample 004 ===== +[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] "the situation is that it will be improved," he said. [SEP] "normally, ideally, people would see it later in the next month, doing it at least once a month," said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP] + +===== sample 005 ===== +[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, "and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff's department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP]" it [SEP] + +===== sample 006 ===== +[CLS] prosecutors in the mclelland case review the federal grand jury's findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government's last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can't imagine texting a baby, or [SEP] + +===== sample 007 ===== +[CLS] receive a guaranteed bonus of $4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] " i'll tell you today, he's much more effective than now. [SEP] these institutions are not entirely strangers; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP] + +===== sample 008 ===== +[CLS] - of - one match to finish in the overall standings for the opening round. [SEP] leeds does not play its final home game after a 4 - 3 defeat to bohemians three days ago. [SEP] he refused to leave the post office until after april 2010 and will be able to announce details of his plans until the next year. [SEP] a 30 - year - old man has been bailed after a 22 - year - old man was found stabbed on london's regent street. [SEP] it is building a team of senior management and top financial advisors to take on the job. [SEP] but it is a turning point in the history of the [SEP] + +===== sample 009 ===== +[CLS] county's emergency management office. [SEP] he told e - mails that the officers told him they had fired him, and after the officer got out of hand moved out and arrested the men. [SEP] it was not clear whether the case was being investigated before or whether prosecutors were due to court. [SEP] this is not the time for this fight. [SEP] that night, they had been locked up inside the club. [SEP] however, the report says that any changes should not stand in the way of the public inquiry and accountability for those claims. [SEP] and yet there is no point to think it irrationally. [SEP] installation is $29, [SEP] + +===== sample 010 ===== +[CLS] scientists at the national park are waiting to see if the virus replicates itself in the public. [SEP] james is hoping to force england into seventh place in his squad when he faces the world championships in rome later. [SEP] if you're young, light and clever, you'll just feel you're getting too tired of it. [SEP] the 12 - month growth rate slipped 0. 5 point to 7. 0 percent, which was down the 7. 5 percent expected in april. [SEP] bae could secure a £430m deal for the aegis helicopter system, which the u. s. air force is seeking to build [SEP] + +===== sample 011 ===== +[CLS]. [SEP] georgian officials also alleged that russian troops had carried out operations to disarm in south ossetia, which was the headquarters for u. s. and u. n. peacekeeping forces in afghanistan. [SEP] more recently, there was no immediate evidence to support the theory that the dead woman had been shot to flee the scene of the crime. [SEP] donaldsfeld, the vice president's science adviser and the chief executive of the joint national security council, is leading a research program at the national institute of economic studies. [SEP] the governor confirmed at a press news conference that the legislature approved the bill scheduled for march 1, [SEP] + +===== sample 012 ===== +[CLS] will never be stopped. [SEP] it's a place where people can spend time with a family, to keep the quiet. [SEP] the result is the level of support for the auto industry. [SEP] chrysler will have to make another reorganisation in its business units before the end of the year. [SEP] "i think a lot more needs to be done for our national security," said alan ashburn, head of the congressional budget office. [SEP] it was the second of october - - almost six years ago when the iraqi police chief made the nomination for his job, announced at a meeting of the provincial council in the central square. [SEP] the [SEP] + +===== sample 013 ===== +[CLS], including people in his family. [SEP] he moved out of san diego for his fourth - straight preseason game, going 3 - 1, to make the postseason the regular season. [SEP] mr power was the subject of a scandal in office last year but has said that he is helping with legal proceedings, despite facing impeachment proceedings and corruption charges. [SEP] if i hadn't held my son alive, the officers would probably very easily have done no harm, " he added. [SEP] the hurricanes' league most famous victory was a 5 - 4 thrasher on thursday night against nashville. [SEP] under new guidelines, health experts have failed to [SEP] + +===== sample 014 ===== +[CLS] for the first new session on the iranian crisis in four years, and threatened to hold talks in three days' time without reaching a deal. [SEP] nobody wants a doctor to find the full x monitor to stay in the operating room. [SEP] brown, born in 1965 and once served at the u. s. army headquarters, initially received a brief b. d. in 1963 from the virginian university medical school, near the university of illinois law. [SEP] bank of america corp was selling a stake in a bank with net worth of $1. 8 billion to the u. s. u. s. federal reserve, the head of [SEP] + +===== sample 015 ===== +[CLS] [SEP] he's free, but it won't work in his health either. [SEP] however, the imf's position has been to make it easier for banks to raise capital. [SEP] a government study found men working in apprenticeships were more likely to succeed those who left work just weeks after leaving for a formal appointment at the school year. [SEP] she said she thought she had to save her son, mr obama. [SEP] land securities said it would update its financial ratios during the third quarter of trading. [SEP] the boy did have two children but the parents said he did not want to attend a school which had children outside their [SEP] + +===== sample 016 ===== +[CLS]. bailoutreagh. com. [SEP] the average interest rate on the loan would be about $2. 60 to $3. 70 for the loan. [SEP] they go home and regularly sleep in a wheelchair, while 8 - year - old aaron and his mother take their son into the hospital, family and friends reported. [SEP] in a partly autobiographical account of david morrison's complicated life, he is best known to look at the best of his novels, including his novels as the boy's child, as well as as the original author of the children's story and "dirty dancing" writer david wells. [SEP] we [SEP] + +===== sample 017 ===== +[CLS] open to the public in september. [SEP] the while the trade took place in the us, the fish were active in the 1980s and 1990s. [SEP] "you can't have a budget because you know what you're going through - - you have a lot of money, and that's a lot of faith in the money," he said. [SEP] the first was the name of a former cargill employee. [SEP] but at some point he's got someone that has the same quality as everyone, and he has played well enough. [SEP] we could go to a very good hospital, "he said. [SEP]" we [SEP] + +===== sample 018 ===== +[CLS] [SEP] a zimbabwean military plane landed saturday just minutes after flying to the island 90 miles south of the capital on the coast of south africa. [SEP] in addition to being a senior striker, supported by harry redknapp, the spurs manager, who dismissed the idea that rooney alone, if he completed his first goal, he could be considered part of chelsea's top squads. [SEP] the fbi, the investigation unit, the office of the federal bureau of investigation and the fbi coordinate efforts in the investigation of the workplace violence. [SEP] bhp billiton has accepted the outcome in its own offer ahead of target of 3p for the [SEP] + +===== sample 019 ===== +[CLS] [SEP] palin said state law enforcement officers have complained about police complaints and the use of 24 - hour days of alerts that many have cancelled because of potential violations. [SEP] it was david smith in the first scottish national orchestra, north west scotland, who recorded the final part and composed franz zamlik's "strange goodfellas." [SEP] appointments.. a good opportunity is available for real estate.... £262 - £24999 per annum + bonus.. british olympic association. leeds. £299 - - £26, 000 + bonus.. c £30000 per annum + bonus [SEP] + +===== sample 020 ===== +[CLS] over five years ago. [SEP] "when i think that people would think about him is i'll ask for a pardon, you want to get your child out of a prison, you must be released," she said. [SEP] the national price rate is still at its highest level of inflation since 2001, but the government could afford to follow the record. [SEP] maj robert h. reid, head of britain's chief of naval staff, made an unprecedented appeal after five officers from the joint chiefs of staff were charged with an incident of suspected car theft. [SEP] the search is now way to determine the circumstances leading up to her death [SEP] + +===== sample 021 ===== +[CLS] down in 2005, most local officials would not seem to wind up doing this job. [SEP] you'll do something you didn't do years ago. [SEP] a 4 - 0 champions league win, when they had only 15 players, ended their season in october 2009, and it took them to beat manchester united to get into the championship game. [SEP] china is the world's most important economy and it is expected to create hundreds of thousands of jobs around the world. [SEP] the man has been granted a bail order, but was later released on bail. [SEP] in fact, its geoclinist has become a popular instrument - [SEP] + +===== sample 022 ===== +[CLS] change in performance or factors that could affect the company's current performance or we have to act on other statements of management to reflect future developments, the impact of pre - historical performance and performance, unexpected financial risks or events that could affect the accuracy or accuracy of the new information, potential criminal charges, regulations, or the interpretation of the information, or the public. [SEP] yahoo inc. amended its plan to combine yahoo with search ads in january, in a bid to modernize yahoo. [SEP] "if patients are referred to an emergency, which is in a few hours, at the hospital after the onset of a flu outbreak," [SEP] + +===== sample 023 ===== +[CLS] said it was satisfied there is a "serious flaw" in the judges' decisions. [SEP] in many cases, staff are usually forced to call in a telephone, but people complain and the numbers are always based on the call call. [SEP] in the past three years, the government, the federal police state council and the army were on track to launch new enforcement activities, according to the statement. [SEP] the court had permission for mr brown to turn the second session into a session but the end - of - session session was interrupted by his outburst. [SEP] she also has a large tricer in her headgegus. [SEP] following his long [SEP] + +===== sample 024 ===== +[CLS] prices. [SEP] one issue currently under discussion is allowing the house to pass legislation. [SEP] bernanke said the fed would cut rates and keep rates low through next sept. [SEP] the country is the no. 1 in india's developing economy, with exports falling under 21 percent of gdp in december of last year. [SEP] banksy, one of the leading british architects of the generation, worked for thirty years as a research assistant to the royal academy of music and to become a b lecturer and then associate professor of mathematics of the royal college society. [SEP] the children are usually too small or large for their jobs. [SEP] no action could [SEP] + +===== sample 025 ===== +[CLS] the un security council approved the bill to question the legality of the constitution. [SEP] he said the metropolitan police police has launched an internal investigation into several county - level employees, including 10 officers who are disciplined and disciplined after complaints about officers while they carry out their duties. [SEP] it was in the five months before he went to college and arranged for her to enroll in college. [SEP] a resident dropped five to seven vases off the floor in the centre of the building. [SEP] the rate of weight loss increased from high levels - - 14 percent to 18 percent in 2001 and 2 percent in 2007, according to the research center. [SEP] [SEP] + +===== sample 026 ===== +[CLS]. 500 in game three last sunday. [SEP] all three of those attacks have been linked to a terrorist network run by the american military, including the leader of al qaeda. [SEP] aerospace group boeing co. is expected to report disappointing full - year results and the outlook for its debt has sparked a steady stream of sales. [SEP] but the euro rose to 1. 6295 dollars from 1. 663. [SEP] this week's list included four schools, which received $1 million, six awards in 2006 and $3. 5 million in grants this year. [SEP] mr eide is iran's closest diplomat. [SEP] i still [SEP] + +===== sample 027 ===== +[CLS] critically injured in a series of attacks at a nightclub. [SEP] new home home secretary alan johnson has warned the government of the need for further legislation. [SEP] the state health department on thursday announced that legislation to change the amount of smoking is also pending. [SEP] a few of her students, aged in nursery class, did not have enough space to breathe. [SEP] the attack came after a security council report that the children were expelled from the foreign office in a government building. [SEP] wali ali, a former commander in the north, declined to be named, and said he was killed in the southern city. [SEP] he was only 20 years of [SEP] + +===== sample 028 ===== +[CLS] - section of congress. [SEP] mr clark has issued a statement for an public inquiry which is expected later. [SEP] miami, florida (cnn) - - the country's election commission rejected the military officers who had ousted the controversial "military coup" of president general pervez musharraf, the interim president said saturday. [SEP] however, while the us bank of bank of japan could cut rates today, a vice - chairman of the fed's policy committee said there had been no real sign of the recession. [SEP] richard davies, a fire service spokesman at south general nhs trust, said the service had been restored after the alarm [SEP] + +===== sample 029 ===== +[CLS] ruled in his favor. [SEP] now we're facing the threat of a recession. [SEP] copper fell nearly 1. 8 per cent to $647, or 6. 9 per cent to $1, 007. 70. [SEP] the judge said the prosecution's case was adjourned until nov. [SEP] it says people should have the self - control experience to think and behave with a sense of normalness. [SEP] last night, the lakers had their best team to make it to the final four. [SEP] the details of the latest fight weren't immediately clear. [SEP] about 90 percent of the changes to the state ' [SEP] + +===== sample 030 ===== +[CLS]25 or (888) 92720, u. s. dollars, or calling (0) 426 8106 or ( international (1) pass code 889981000 or pass code 20008. [SEP] the mod dismissed the increased claims of air strike orders, and added that it was reviewing procurement options on its current joint strike aircraft. [SEP] the federal trade commission has been set for an inquiry on whether to press charges. [SEP] and i was also holidaying in the family's holiday holiday home, which has vaulted ceilings, the hot weather, terraces and a roof. [SEP] john brown, the chairman [SEP] + +===== sample 031 ===== +[CLS] regiment took part in the military action of southern afghanistan. [SEP] former army commander lt. gen. keith pasquio, commander of the army's staff, said the war may be in need of an open debate between their commanders, including stanley mcchrystal and genel schwartz, the commander appointed by gen. george w. mcgeo, who was fired aug, to serve until his troops leave in august. [SEP] "there's been some criticism over the last couple of months, and the state is not acting too much for me," he said. [SEP] the former president was nominated for the presidency in 1975 [SEP] + +===== sample 032 ===== +[CLS] series of flats on the fifth floor. [SEP] mr. jackson declined to acknowledge that jackson's death was delayed or his death would not be reported. [SEP] he said the unemployment rate dropped 4 percent on the year - - its highest - - since hitting 12. 2 percent in september 2006, about 7: 30 p. m.. [SEP] to economists, the fedc was very much paying attention to the fact that the current financial market crisis was among the most serious and unprecedented in modern history. [SEP] the crowd was stunned by the size of the wall of the white house, but they didn't see the president, any more [SEP] + +===== sample 033 ===== +[CLS] third quarter. [SEP] "it is the duty to make the decisions of the game solely in the context of the legal and legal authorities and any information, or advice to any financial professional or authority, which may be appropriate to appeal. [SEP] last year nearly all of the country's 65 million people enrolled in their high education and many enrolled in the united states. [SEP] he was also jailed as a juvenile and given a discharge for his behaviour. [SEP] while sen clinton won nevada, he praised the party's decision to build a" preliged voting base " in the state primary for obama. [SEP] in the terms of the report [SEP] + +===== sample 034 ===== +[CLS] language because it could not affect the tone of his speech. [SEP] the report came as the white house released a report that president obama will divert $35 billion a year from the stimulus program. [SEP] the company's third quarter net profit was $. 9 billion, on weakness in the u. s. and european markets. [SEP] many of the new visitors are in the united states. [SEP] texas tech has won three of its last four games in texas. [SEP] the majority dismissed the allegations against paterson, however, calling it a written question regarding the firing of a state's attorney. [SEP] they're looking for someone else, [SEP] + +===== sample 035 ===== +[CLS] of former chief executive peter moore, pending the results of an internal review, the irb said in a statement on sunday. [SEP] but mr mukasey says that there are legal challenges to the idea that judges should be put in jeopardy. [SEP] the man could also have been jailed for 15 years. [SEP] in 1980 president george bush used the torch for a visit to the state's infantrymen's hospital, as well as the queen, to present his tribute to the service of victims during the vietnam war. [SEP] china's sovereign wealth market made an annual but record annual profit of rmb43bn in 2008 because of [SEP] + +===== sample 036 ===== +[CLS] an average of 8. 4 per cent over the next six months, with the biggest double - annual increase of 7 per since september 2006. [SEP] david marty served as deputy secretary of state for african affairs. [SEP] ryan taylor, 19, a doctor at the university hospital, died saturday, a day after he wrote out his crime. [SEP] it also makes illumine inc, the maker of alcoa inc., which also makes fermo's namesake coffees, and j. c. penn, the world's biggest - selling maker of consumer products used in its cars. [SEP] it was a decision i made [SEP] + +===== sample 037 ===== +[CLS] officer councillor jim porter said: " i thought i made it the most obvious aspect of this situation after i was told it was a serious problem. [SEP] the lodge is currently open to all guests, and a hotel and other facilities have been available for the event, opening in november. [SEP] later wednesday, u. s. and coalition forces took control in western kunar province, which is near an important area where government troops operate. [SEP] president nawaz sharif's former deputy, muqtadah al - islami, and later the chief minister, gen. naqrq kayani will be vice president. [SEP] [SEP] + +===== sample 038 ===== +[CLS] have a lot of student children at college and my daughter at school, but probably because i will almost always get reminders of the alphabet at school rather than at school. [SEP] following a recent appearance by mrs. clinton, a former mr. obama and one colleague now appearing on state television, which calls mr. obama to be the vice president, said the 42 - year - old obama appeared safe. [SEP] she argued that she should be suspended by the national investigation and complaints commission, where she had been kept confidential and was not only allowed to under the rules of conduct, she did not need a formal investigation. [SEP] child and father [SEP] + +===== sample 039 ===== +[CLS] of the modern era. [SEP] police said the fifth child, briane mason, in the kitchen in clapham road, herts, suffered from a gastrointestinal complaint. [SEP] he said that it was good that some of the money would not be left in reserve. [SEP] "it's a little hard for us to pay prices," she says. [SEP] most of all, i didn't drive three miles long before i could call a colleague to look up the phone. [SEP] take the "top chef" star tom watson, the show co - based based on the bbc's fourth book, the rules [SEP] + +===== sample 040 ===== +[CLS] town of perth and went missing on a sunday after a long holiday, the court heard. [SEP] the pentagon says at least 20, 000 people in excess of nearly 7 million people were killed in the war - - the largest toll of iraq's so long occupation and occupation of southern iraq. [SEP] in 2003, the city's financial planning board took up the application. [SEP] the former footballer david mercer has pleaded guilty to false suicide charges after being arrested and questioned on suspicion that she had been poisoned. [SEP] bolt would also secure a gold medal for 100m for american shawn johnson, who is third of the 100, 000m world [SEP] + +===== sample 041 ===== +[CLS] gas stations. [SEP] the u. s. department of energy had increased the total oil supply supply for processing by 1, 000 and 1, 000 bps. [SEP] that morning, officers said, officers arrived outside a nearby apartment building, which he thought closed because he was running a night's work. [SEP] "it's changing." [SEP] john hogger was a member of labour's internal law inquiry committee and the former no. 2, john mcgrady, chair the public inquiry. [SEP] to give this, i sent notes to a visiting fellow teacher and asked for an interview. [SEP] (ap) - a [SEP] + +===== sample 042 ===== +[CLS] mike adams, deputy superintendent mike o' brien and barbara morgan, a fourth - grader. [SEP] all six men are out for about four weeks before a tour of australia, which he is scheduled to begin next year. [SEP] he can only drive in half - way, thinking of his mates and soon picks up a laptop and sits his sleep on the front floor of his bed. [SEP] £1. 99 - $0. 99 £199; www. £69. 99. [SEP] arsenal lost their fa cup final meeting at crystal palace on the night just 12 hours after liverpool made a play - off trip to tottenham hotspur. [SEP] + +===== sample 043 ===== +[CLS] [SEP] the company's executive director, mohammed gbadi, is a former employee. [SEP] but even if the crisis is not temporary, a run - up in prices is not the case. [SEP] the u. n. news agency reported sunday that the united states had "fully located" the missiles and were continuing to place them in the same location. [SEP] the council president, paul mason, demanded an "independent review" inquiry. [SEP] in his decision, judge phillips said that the us authorities had allowed any proceedings to proceed - - or out of court - - to be filed as quickly as a court suit was necessary. [SEP] [SEP] + +===== sample 044 ===== +[CLS], says the sheriff's office investigated the county's call after responding to an incident at home in sequito. [SEP] by the end of the year, a number of claims are expected to be 14, 000, officials said. [SEP] if this goes on forever, we are about to be forever locked in the bubble zone. [SEP] i don't think that is true - i know it was true and do not deny that. [SEP] keep being happy with him too. [SEP] i haven't heard anything about it. [SEP] but i was doing well.... not too fast. [SEP] robert burns, the former [SEP] + +===== sample 045 ===== +[CLS]ws. com. [SEP] the family sister, john johnson, said she had been called by the mother about a drunken incident. [SEP] that was normal. [SEP] "doing good is a different kind of sport. [SEP] president obama has stated in a speech that during former president bill clinton's administration, us president george bush would be" more than 100 days " for members of the military. [SEP] meanwhile, older people are leaving their parents in primary school or after their primary school or staying in over the summer or fall. [SEP] it is long enough for mitchell, who is not out until the game, but he made no secret of his [SEP] + +===== sample 046 ===== +[CLS] the league's first straight home title. [SEP] the fillings start at £2. 99, and are topped with wine. [SEP] you are a pretty good. [SEP] zelaya refused to run an interim government, following his initial stint as a spokesman in the army. [SEP] the matter is being investigated by parliamentary authorities. [SEP] this isn't culture at all, it is about politics. [SEP] he says he had a full set of symptoms, which required him to get the phone back to his doctor for several months. [SEP] "this previous decision, with the risk of a very bad pregnancy, could have had a significant impact," [SEP] + +===== sample 047 ===== +[CLS] the report. [SEP] yet the vote could be a significant slowdown in a country which has fallen short of recession in public campaign promises. [SEP] when i come here i will travel with a new head coach. [SEP] bent, 27, joined the arsenal football side from blackburn almost almost a decade ago and has played major part in the club in the past. [SEP] the fire authority deferred that building works were still going on at its building site, but originally said no work would take place in the county. [SEP] sharif had already issued a list to run for musharraf, and says that he does not see that " presidential [SEP] + +===== sample 048 ===== +[CLS]. military says most of its soldiers, known as marine infantry, now has a 100 - strong operations base in iraq, but it maintains a special operations command there that includes more than 2, 000 marines ahead of a new american strategy in the south. [SEP] it's not the case in the real world. [SEP] even its problems have been a disappointment. [SEP] officers made the call to jackson within the first three minutes, the inquiry said. [SEP] for more information, visit http://www. cri. org. [SEP] he was free to be reached until less than a month ago. [SEP] since the current financial crisis, [SEP] + +===== sample 049 ===== +[CLS], a joint venture of cnn and several other media news agencies. [SEP] these include the royal national trust & trust (0172 72009) and the restoration trust from £975, 000. [SEP] the mayor says the scheme will allow candidates to be part in the national election contest. [SEP] "and many of them were found and shot in the head, causing no injuries. [SEP] many companies have built large operations, some have a small scale base in the uk. [SEP] they became interested in the case of a young pub worker who was jailed for murder. [SEP]" it's an extremely small process, not a big [SEP] + +===== sample 050 ===== +[CLS] than enough to win this year's general elections, the electorate will become critical to the president's plans. [SEP] american airlines chief executive scott tankleff said tuesday the company couldn't try to push back, and could not conclude a deal. [SEP] the new and current tests are expected to be published and published early next year. [SEP] the show will revert to its non - public location on "60 minutes" in 2010. [SEP] she had only since been released from the hospital. [SEP] since we waited for three months, though, it probably won't be long. [SEP] it is believed her family had died, [SEP] + +===== sample 051 ===== +[CLS] people to any health centre. [SEP] in fact, the lower high court could not be said; the chief chief justice should have been more cowed. [SEP] when a large number of his family were missing, the family bought a house and he was dead. [SEP] he was ordered held without bond and was returned to prison tuesday. [SEP] other senate members have expressed similar concerns. [SEP] along with a weak housing market, obama has argued for concessions on key parts of the proposed bill. [SEP] a seasoned brand manager, heinemann remains the company's leading on - line designer, overseeing all products. [SEP] " his family are not part [SEP] + +===== sample 052 ===== +[CLS] said. [SEP] by then, turns out, it had been smith's final game of the night, she sent him to high school and had his notebooks for sleep. [SEP] ms lyn jones said a number of local people had attended the council's meeting. [SEP] however, the bbc has no more details. [SEP] if they did agree, it will probably take another three months. [SEP] the russian defense department has said it is unlikely to make a "satisfactory approach" to the oil issue. [SEP] mr ward, 53, of sudbury, suffolk, is expected to be sentenced at the city of norwich magistrates court in norwich on [SEP] + +===== sample 053 ===== +[CLS]. [SEP] his fault? [SEP] if we change the constitution, the situation will change, "he said. [SEP] in that way, they'd better take responsibility for that this attack took place. [SEP] the air force national survey service said after three hours there had been no reports of uproar on land, with up to 20 trapped people still in the area. [SEP] the independent police complaints commission said the force had" received no reports of a conflict of public interest. " [SEP] the first is you can make your decision, even when you slow down. [SEP] the speed of the new system needs to be measured in order to create [SEP] + +===== sample 054 ===== +[CLS] the authorities in dealing with such a situation. [SEP] set in the aftermath of the cold war in 1980. [SEP] some companies do not have clear policies to set their profit targets. [SEP] the show creators wanted to write a playlist and did not want to write them in the short iterations of their original series. [SEP] the council has imposed a penalty of 30 months, a ban usually imposed, after completing its three - year extension earlier this month. [SEP] the plane was left on the fifth floor of the hotel and exited in front of the crowd. [SEP] he said he believes new information will be used for prevention. [SEP] the car, [SEP] + +===== sample 055 ===== +[CLS]q ). [SEP] shortly after american officials called to help, the bombing victim was not named as his killer, only to be arrested in the killings. [SEP] however, western officials said that at least four of the pakistani police had been killed, including 10 militants. [SEP] they said he claimed to have the victim shot outside the house monday night and that the rampage ended with his father's death. [SEP] it's difficult to gauge, " he says. [SEP] judge stephen j. kagan, the assistant commissioner of alaska, is the former assistant california attorney general for criminal investigation. [SEP] he also said a full - duty police officer [SEP] + +===== sample 056 ===== +[CLS] that, probably because, ' oh, in order to do it i need a lot of money, i'm sorry, and i feel that there is no disingenuous to have some kind words in my voice. [SEP] august 21 - 5 p. m., w. broad street society, 1, 14th street, east n. 1615. [SEP] in the years she married timothy gordon, he became a b. h. fan. [SEP] e. r. k. malek, who is a conservative activist, also has not been promoted. [SEP] "it's a long, a long week," says [SEP] + +===== sample 057 ===== +[CLS] workers began taking off the syringes and other sprits - - including coffee sandwiches and christmas tree meals - - to take patients. [SEP] people who were asked to do so would have to register to post questions in an hour or so before the full details, call 0177 79707 or 01706 7300000. [SEP] it's a very serious issue. [SEP] for the moment, he is not quite convinced but he insists we are at big risk. [SEP] last week, the house ethics committee failed to rule on the allegations of money and, apparently to avoid it, passed ethics rules that would ban spending [SEP] + +===== sample 058 ===== +[CLS] value of the house's value. [SEP] well, says mr. rauf. [SEP] british energy finished up 6. 4 percent to 6, 952. 5p, while shares of gas rose 6. 5 percent to 2. 5p. [SEP] det con chris brown also said the court would know that mr smith had waited for the morning after the robbery before he appeared in court at the time of his death. [SEP] the last election elections for european parliament was held in 1991. [SEP] "this is not a moment we believe we are heading for," he said. [SEP] police now know who has been killed, and even [SEP] + +===== sample 059 ===== +[CLS] negative effects of the financial crisis leads to higher demand for available money for education, health and anti - poverty treatment programs and other measures to finance prevention programs, the report added. [SEP] it wasn't a bad show either way, either. [SEP] bad debt was among the worst in the financial crisis. [SEP] last year e4, the uk's third - largest telephone provider, negotiated a 6 % cut in its fixed - rate contract with vodaq. [SEP] the use of electricity generates around 17 % of the world's power available abroad. [SEP] the first bombings, in which more than 20 percent of muslims were killed in [SEP] + +===== sample 060 ===== +[CLS] to leave him while he would take part in the games. [SEP] the georgian commander, alexander kalirad, said the russian force had started a major offensive in the south osh region, advancing georgian anti - aircraft troops. [SEP] the means that patients may be prepared for further treatment - - - such as a longer hospital waiting period - - is not available, either 10 to 18 or 20 months after or nine months after surgery or diagnosis. [SEP] after all, he was competing at twickenham with david smith in 2002, after impressing in a dramatic final victory 27 years ago. [SEP] " a proposed human rights commission is the way [SEP] + +===== sample 061 ===== +[CLS] new election would be held every seven years. [SEP] this year, there were other drops in oil production prices, including in nigeria and in the us, the group said. [SEP] wednesday's record price was $2. 5 million. [SEP] a 64 - year - old welsh man has died in critical condition after being hit by a car in an accident on a bus in dorset. [SEP] the man was taken to southampton university hospital's emergency room four hours later, and is in hospital for further treatment. [SEP] the baltimore county police are investigating and investigating since 2003. [SEP] his focus will be on monday's performance and the return [SEP] + +===== sample 062 ===== +[CLS] the state's chief prosecutor has been suspended by the attorney general's office after holding an independent report of state sexual violations of state law enforcement law. [SEP] the chief general also named key figures, including lt. gen. mohammed zaqqani and abdul - qassim al - ahmadi, the deputy vice - chief of operations abdul - haq. [SEP] shortly after she was recorded on a radio station, the officers found documents she had cut down - - saying she had broken the stairs and was still gone. [SEP] she was the only back - sitter in the three women's skiing and world cup pairs events [SEP] + +===== sample 063 ===== +[CLS] 52. 1 percent for 2, 500 yards in the 2005 - 06 regular season. [SEP] the u. s. military closed the formal investigation into the cause of the shooting and turned it down. [SEP] the 61 - year - old was paid £21, 900 for his office expenses, rising to £91, 200, and £69, 560 for his home alone in march 2006 to £204, 997. [SEP] earlier, the company had confirmed cases of sanlulu1: flu in asia, but it has ordered 2. 2 million pounds of high - grade bird sanlu, authorities said. [SEP] in [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/argmax_const1p45_noise_c256_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/argmax_const1p45_noise_c256_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..c5249e0dca1847280ca8dd4b6ba1e63cad6c1c12 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/argmax_const1p45_noise_c256_raw_samples.txt @@ -0,0 +1,236 @@ +argmax_const1p45_noise_c256 +{ + "type": "summary", + "name": "argmax_const1p45_noise_c256", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "argmax_const1p45_noise_c256", + "steps": 128, + "temp_start": 1.45, + "temp_end": 1.45, + "temp_schedule": "const", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_cosine", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "argmax", + "final_temp": 1.0, + "top_k": 0, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 43.01780486436395, + "nll_per_token": 3.761614096604754, + "tokens": 9644 + }, + "diversity": { + "sample_entropy": 4.198717295568989, + "unique_tokens": 1974, + "token_count": 8192, + "distinct_1": 0.240966796875, + "distinct_2": 0.7169045275590551, + "top_token_mass": 0.0582275390625 + } +} + +===== sample 000 ===== +[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world ' s biggest credit - card companies and stripped out $ 6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] " we ' re very involved in policing schools, roads and buildings and we ' re working all over london to find incidents like this, " he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon ' s appointment as a former u. n. [SEP] + +===== sample 001 ===== +[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence ' s specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP] + +===== sample 002 ===== +[CLS] wouldn ' t be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company ' s board voted overwhelmingly in support of president obama ' s plans in iraq for the next six months, leaving at least $ 200 billion over two months of war time. [SEP] no, he didn ' t know all the extra money. [SEP] the proposed changes would undermine the core of the state ' s constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP] + +===== sample 003 ===== +[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $ 3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel ( 020 78777 ; www. explore. co. uk ), revenue & customs holidays ( 020 730000 ) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP] + +===== sample 004 ===== +[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] " the situation is that it will be improved, " he said. [SEP] " normally, ideally, people would see it later in the next month, doing it at least once a month, " said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP] + +===== sample 005 ===== +[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, " and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff ' s department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP] " it [SEP] + +===== sample 006 ===== +[CLS] prosecutors in the mclelland case review the federal grand jury ' s findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government ' s last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can ' t imagine texting a baby, or [SEP] + +===== sample 007 ===== +[CLS] receive a guaranteed bonus of $ 4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] " i ' ll tell you today, he ' s much more effective than now. [SEP] these institutions are not entirely strangers ; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP] + +===== sample 008 ===== +[CLS] - of - one match to finish in the overall standings for the opening round. [SEP] leeds does not play its final home game after a 4 - 3 defeat to bohemians three days ago. [SEP] he refused to leave the post office until after april 2010 and will be able to announce details of his plans until the next year. [SEP] a 30 - year - old man has been bailed after a 22 - year - old man was found stabbed on london ' s regent street. [SEP] it is building a team of senior management and top financial advisors to take on the job. [SEP] but it is a turning point in the history of the [SEP] + +===== sample 009 ===== +[CLS] county ' s emergency management office. [SEP] he told e - mails that the officers told him they had fired him, and after the officer got out of hand moved out and arrested the men. [SEP] it was not clear whether the case was being investigated before or whether prosecutors were due to court. [SEP] this is not the time for this fight. [SEP] that night, they had been locked up inside the club. [SEP] however, the report says that any changes should not stand in the way of the public inquiry and accountability for those claims. [SEP] and yet there is no point to think it irrationally. [SEP] installation is $ 29, [SEP] + +===== sample 010 ===== +[CLS] scientists at the national park are waiting to see if the virus replicates itself in the public. [SEP] james is hoping to force england into seventh place in his squad when he faces the world championships in rome later. [SEP] if you ' re young, light and clever, you ' ll just feel you ' re getting too tired of it. [SEP] the 12 - month growth rate slipped 0. 5 point to 7. 0 percent, which was down the 7. 5 percent expected in april. [SEP] bae could secure a £430m deal for the aegis helicopter system, which the u. s. air force is seeking to build [SEP] + +===== sample 011 ===== +[CLS]. [SEP] georgian officials also alleged that russian troops had carried out operations to disarm in south ossetia, which was the headquarters for u. s. and u. n. peacekeeping forces in afghanistan. [SEP] more recently, there was no immediate evidence to support the theory that the dead woman had been shot to flee the scene of the crime. [SEP] donaldsfeld, the vice president ' s science adviser and the chief executive of the joint national security council, is leading a research program at the national institute of economic studies. [SEP] the governor confirmed at a press news conference that the legislature approved the bill scheduled for march 1, [SEP] + +===== sample 012 ===== +[CLS] will never be stopped. [SEP] it ' s a place where people can spend time with a family, to keep the quiet. [SEP] the result is the level of support for the auto industry. [SEP] chrysler will have to make another reorganisation in its business units before the end of the year. [SEP] " i think a lot more needs to be done for our national security, " said alan ashburn, head of the congressional budget office. [SEP] it was the second of october - - almost six years ago when the iraqi police chief made the nomination for his job, announced at a meeting of the provincial council in the central square. [SEP] the [SEP] + +===== sample 013 ===== +[CLS], including people in his family. [SEP] he moved out of san diego for his fourth - straight preseason game, going 3 - 1, to make the postseason the regular season. [SEP] mr power was the subject of a scandal in office last year but has said that he is helping with legal proceedings, despite facing impeachment proceedings and corruption charges. [SEP] if i hadn ' t held my son alive, the officers would probably very easily have done no harm, " he added. [SEP] the hurricanes ' league most famous victory was a 5 - 4 thrasher on thursday night against nashville. [SEP] under new guidelines, health experts have failed to [SEP] + +===== sample 014 ===== +[CLS] for the first new session on the iranian crisis in four years, and threatened to hold talks in three days ' time without reaching a deal. [SEP] nobody wants a doctor to find the full x monitor to stay in the operating room. [SEP] brown, born in 1965 and once served at the u. s. army headquarters, initially received a brief b. d. in 1963 from the virginian university medical school, near the university of illinois law. [SEP] bank of america corp was selling a stake in a bank with net worth of $ 1. 8 billion to the u. s. u. s. federal reserve, the head of [SEP] + +===== sample 015 ===== +[CLS] [SEP] he ' s free, but it won ' t work in his health either. [SEP] however, the imf ' s position has been to make it easier for banks to raise capital. [SEP] a government study found men working in apprenticeships were more likely to succeed those who left work just weeks after leaving for a formal appointment at the school year. [SEP] she said she thought she had to save her son, mr obama. [SEP] land securities said it would update its financial ratios during the third quarter of trading. [SEP] the boy did have two children but the parents said he did not want to attend a school which had children outside their [SEP] + +===== sample 016 ===== +[CLS]. bailoutreagh. com. [SEP] the average interest rate on the loan would be about $ 2. 60 to $ 3. 70 for the loan. [SEP] they go home and regularly sleep in a wheelchair, while 8 - year - old aaron and his mother take their son into the hospital, family and friends reported. [SEP] in a partly autobiographical account of david morrison ' s complicated life, he is best known to look at the best of his novels, including his novels as the boy ' s child, as well as as the original author of the children ' s story and " dirty dancing " writer david wells. [SEP] we [SEP] + +===== sample 017 ===== +[CLS] open to the public in september. [SEP] the while the trade took place in the us, the fish were active in the 1980s and 1990s. [SEP] " you can ' t have a budget because you know what you ' re going through - - you have a lot of money, and that ' s a lot of faith in the money, " he said. [SEP] the first was the name of a former cargill employee. [SEP] but at some point he ' s got someone that has the same quality as everyone, and he has played well enough. [SEP] we could go to a very good hospital, " he said. [SEP] " we [SEP] + +===== sample 018 ===== +[CLS] [SEP] a zimbabwean military plane landed saturday just minutes after flying to the island 90 miles south of the capital on the coast of south africa. [SEP] in addition to being a senior striker, supported by harry redknapp, the spurs manager, who dismissed the idea that rooney alone, if he completed his first goal, he could be considered part of chelsea ' s top squads. [SEP] the fbi, the investigation unit, the office of the federal bureau of investigation and the fbi coordinate efforts in the investigation of the workplace violence. [SEP] bhp billiton has accepted the outcome in its own offer ahead of target of 3p for the [SEP] + +===== sample 019 ===== +[CLS] [SEP] palin said state law enforcement officers have complained about police complaints and the use of 24 - hour days of alerts that many have cancelled because of potential violations. [SEP] it was david smith in the first scottish national orchestra, north west scotland, who recorded the final part and composed franz zamlik ' s " strange goodfellas. " [SEP] appointments.. a good opportunity is available for real estate.... £262 - £24999 per annum + bonus.. british olympic association. leeds. £299 - - £26, 000 + bonus.. c £30000 per annum + bonus [SEP] + +===== sample 020 ===== +[CLS] over five years ago. [SEP] " when i think that people would think about him is i ' ll ask for a pardon, you want to get your child out of a prison, you must be released, " she said. [SEP] the national price rate is still at its highest level of inflation since 2001, but the government could afford to follow the record. [SEP] maj robert h. reid, head of britain ' s chief of naval staff, made an unprecedented appeal after five officers from the joint chiefs of staff were charged with an incident of suspected car theft. [SEP] the search is now way to determine the circumstances leading up to her death [SEP] + +===== sample 021 ===== +[CLS] down in 2005, most local officials would not seem to wind up doing this job. [SEP] you ' ll do something you didn ' t do years ago. [SEP] a 4 - 0 champions league win, when they had only 15 players, ended their season in october 2009, and it took them to beat manchester united to get into the championship game. [SEP] china is the world ' s most important economy and it is expected to create hundreds of thousands of jobs around the world. [SEP] the man has been granted a bail order, but was later released on bail. [SEP] in fact, its geoclinist has become a popular instrument - [SEP] + +===== sample 022 ===== +[CLS] change in performance or factors that could affect the company ' s current performance or we have to act on other statements of management to reflect future developments, the impact of pre - historical performance and performance, unexpected financial risks or events that could affect the accuracy or accuracy of the new information, potential criminal charges, regulations, or the interpretation of the information, or the public. [SEP] yahoo inc. amended its plan to combine yahoo with search ads in january, in a bid to modernize yahoo. [SEP] " if patients are referred to an emergency, which is in a few hours, at the hospital after the onset of a flu outbreak, " [SEP] + +===== sample 023 ===== +[CLS] said it was satisfied there is a " serious flaw " in the judges ' decisions. [SEP] in many cases, staff are usually forced to call in a telephone, but people complain and the numbers are always based on the call call. [SEP] in the past three years, the government, the federal police state council and the army were on track to launch new enforcement activities, according to the statement. [SEP] the court had permission for mr brown to turn the second session into a session but the end - of - session session was interrupted by his outburst. [SEP] she also has a large tricer in her headgegus. [SEP] following his long [SEP] + +===== sample 024 ===== +[CLS] prices. [SEP] one issue currently under discussion is allowing the house to pass legislation. [SEP] bernanke said the fed would cut rates and keep rates low through next sept. [SEP] the country is the no. 1 in india ' s developing economy, with exports falling under 21 percent of gdp in december of last year. [SEP] banksy, one of the leading british architects of the generation, worked for thirty years as a research assistant to the royal academy of music and to become a b lecturer and then associate professor of mathematics of the royal college society. [SEP] the children are usually too small or large for their jobs. [SEP] no action could [SEP] + +===== sample 025 ===== +[CLS] the un security council approved the bill to question the legality of the constitution. [SEP] he said the metropolitan police police has launched an internal investigation into several county - level employees, including 10 officers who are disciplined and disciplined after complaints about officers while they carry out their duties. [SEP] it was in the five months before he went to college and arranged for her to enroll in college. [SEP] a resident dropped five to seven vases off the floor in the centre of the building. [SEP] the rate of weight loss increased from high levels - - 14 percent to 18 percent in 2001 and 2 percent in 2007, according to the research center. [SEP] [SEP] + +===== sample 026 ===== +[CLS]. 500 in game three last sunday. [SEP] all three of those attacks have been linked to a terrorist network run by the american military, including the leader of al qaeda. [SEP] aerospace group boeing co. is expected to report disappointing full - year results and the outlook for its debt has sparked a steady stream of sales. [SEP] but the euro rose to 1. 6295 dollars from 1. 663. [SEP] this week ' s list included four schools, which received $ 1 million, six awards in 2006 and $ 3. 5 million in grants this year. [SEP] mr eide is iran ' s closest diplomat. [SEP] i still [SEP] + +===== sample 027 ===== +[CLS] critically injured in a series of attacks at a nightclub. [SEP] new home home secretary alan johnson has warned the government of the need for further legislation. [SEP] the state health department on thursday announced that legislation to change the amount of smoking is also pending. [SEP] a few of her students, aged in nursery class, did not have enough space to breathe. [SEP] the attack came after a security council report that the children were expelled from the foreign office in a government building. [SEP] wali ali, a former commander in the north, declined to be named, and said he was killed in the southern city. [SEP] he was only 20 years of [SEP] + +===== sample 028 ===== +[CLS] - section of congress. [SEP] mr clark has issued a statement for an public inquiry which is expected later. [SEP] miami, florida ( cnn ) - - the country ' s election commission rejected the military officers who had ousted the controversial " military coup " of president general pervez musharraf, the interim president said saturday. [SEP] however, while the us bank of bank of japan could cut rates today, a vice - chairman of the fed ' s policy committee said there had been no real sign of the recession. [SEP] richard davies, a fire service spokesman at south general nhs trust, said the service had been restored after the alarm [SEP] + +===== sample 029 ===== +[CLS] ruled in his favor. [SEP] now we ' re facing the threat of a recession. [SEP] copper fell nearly 1. 8 per cent to $ 647, or 6. 9 per cent to $ 1, 007. 70. [SEP] the judge said the prosecution ' s case was adjourned until nov. [SEP] it says people should have the self - control experience to think and behave with a sense of normalness. [SEP] last night, the lakers had their best team to make it to the final four. [SEP] the details of the latest fight weren ' t immediately clear. [SEP] about 90 percent of the changes to the state ' [SEP] + +===== sample 030 ===== +[CLS]25 or ( 888 ) 92720, u. s. dollars, or calling ( 0 ) 426 8106 or ( international ( 1 ) pass code 889981000 or pass code 20008. [SEP] the mod dismissed the increased claims of air strike orders, and added that it was reviewing procurement options on its current joint strike aircraft. [SEP] the federal trade commission has been set for an inquiry on whether to press charges. [SEP] and i was also holidaying in the family ' s holiday holiday home, which has vaulted ceilings, the hot weather, terraces and a roof. [SEP] john brown, the chairman [SEP] + +===== sample 031 ===== +[CLS] regiment took part in the military action of southern afghanistan. [SEP] former army commander lt. gen. keith pasquio, commander of the army ' s staff, said the war may be in need of an open debate between their commanders, including stanley mcchrystal and genel schwartz, the commander appointed by gen. george w. mcgeo, who was fired aug, to serve until his troops leave in august. [SEP] " there ' s been some criticism over the last couple of months, and the state is not acting too much for me, " he said. [SEP] the former president was nominated for the presidency in 1975 [SEP] + +===== sample 032 ===== +[CLS] series of flats on the fifth floor. [SEP] mr. jackson declined to acknowledge that jackson ' s death was delayed or his death would not be reported. [SEP] he said the unemployment rate dropped 4 percent on the year - - its highest - - since hitting 12. 2 percent in september 2006, about 7 : 30 p. m.. [SEP] to economists, the fedc was very much paying attention to the fact that the current financial market crisis was among the most serious and unprecedented in modern history. [SEP] the crowd was stunned by the size of the wall of the white house, but they didn ' t see the president, any more [SEP] + +===== sample 033 ===== +[CLS] third quarter. [SEP] " it is the duty to make the decisions of the game solely in the context of the legal and legal authorities and any information, or advice to any financial professional or authority, which may be appropriate to appeal. [SEP] last year nearly all of the country ' s 65 million people enrolled in their high education and many enrolled in the united states. [SEP] he was also jailed as a juvenile and given a discharge for his behaviour. [SEP] while sen clinton won nevada, he praised the party ' s decision to build a " preliged voting base " in the state primary for obama. [SEP] in the terms of the report [SEP] + +===== sample 034 ===== +[CLS] language because it could not affect the tone of his speech. [SEP] the report came as the white house released a report that president obama will divert $ 35 billion a year from the stimulus program. [SEP] the company ' s third quarter net profit was $. 9 billion, on weakness in the u. s. and european markets. [SEP] many of the new visitors are in the united states. [SEP] texas tech has won three of its last four games in texas. [SEP] the majority dismissed the allegations against paterson, however, calling it a written question regarding the firing of a state ' s attorney. [SEP] they ' re looking for someone else, [SEP] + +===== sample 035 ===== +[CLS] of former chief executive peter moore, pending the results of an internal review, the irb said in a statement on sunday. [SEP] but mr mukasey says that there are legal challenges to the idea that judges should be put in jeopardy. [SEP] the man could also have been jailed for 15 years. [SEP] in 1980 president george bush used the torch for a visit to the state ' s infantrymen ' s hospital, as well as the queen, to present his tribute to the service of victims during the vietnam war. [SEP] china ' s sovereign wealth market made an annual but record annual profit of rmb43bn in 2008 because of [SEP] + +===== sample 036 ===== +[CLS] an average of 8. 4 per cent over the next six months, with the biggest double - annual increase of 7 per since september 2006. [SEP] david marty served as deputy secretary of state for african affairs. [SEP] ryan taylor, 19, a doctor at the university hospital, died saturday, a day after he wrote out his crime. [SEP] it also makes illumine inc, the maker of alcoa inc., which also makes fermo ' s namesake coffees, and j. c. penn, the world ' s biggest - selling maker of consumer products used in its cars. [SEP] it was a decision i made [SEP] + +===== sample 037 ===== +[CLS] officer councillor jim porter said : " i thought i made it the most obvious aspect of this situation after i was told it was a serious problem. [SEP] the lodge is currently open to all guests, and a hotel and other facilities have been available for the event, opening in november. [SEP] later wednesday, u. s. and coalition forces took control in western kunar province, which is near an important area where government troops operate. [SEP] president nawaz sharif ' s former deputy, muqtadah al - islami, and later the chief minister, gen. naqrq kayani will be vice president. [SEP] [SEP] + +===== sample 038 ===== +[CLS] have a lot of student children at college and my daughter at school, but probably because i will almost always get reminders of the alphabet at school rather than at school. [SEP] following a recent appearance by mrs. clinton, a former mr. obama and one colleague now appearing on state television, which calls mr. obama to be the vice president, said the 42 - year - old obama appeared safe. [SEP] she argued that she should be suspended by the national investigation and complaints commission, where she had been kept confidential and was not only allowed to under the rules of conduct, she did not need a formal investigation. [SEP] child and father [SEP] + +===== sample 039 ===== +[CLS] of the modern era. [SEP] police said the fifth child, briane mason, in the kitchen in clapham road, herts, suffered from a gastrointestinal complaint. [SEP] he said that it was good that some of the money would not be left in reserve. [SEP] " it ' s a little hard for us to pay prices, " she says. [SEP] most of all, i didn ' t drive three miles long before i could call a colleague to look up the phone. [SEP] take the " top chef " star tom watson, the show co - based based on the bbc ' s fourth book, the rules [SEP] + +===== sample 040 ===== +[CLS] town of perth and went missing on a sunday after a long holiday, the court heard. [SEP] the pentagon says at least 20, 000 people in excess of nearly 7 million people were killed in the war - - the largest toll of iraq ' s so long occupation and occupation of southern iraq. [SEP] in 2003, the city ' s financial planning board took up the application. [SEP] the former footballer david mercer has pleaded guilty to false suicide charges after being arrested and questioned on suspicion that she had been poisoned. [SEP] bolt would also secure a gold medal for 100m for american shawn johnson, who is third of the 100, 000m world [SEP] + +===== sample 041 ===== +[CLS] gas stations. [SEP] the u. s. department of energy had increased the total oil supply supply for processing by 1, 000 and 1, 000 bps. [SEP] that morning, officers said, officers arrived outside a nearby apartment building, which he thought closed because he was running a night ' s work. [SEP] " it ' s changing. " [SEP] john hogger was a member of labour ' s internal law inquiry committee and the former no. 2, john mcgrady, chair the public inquiry. [SEP] to give this, i sent notes to a visiting fellow teacher and asked for an interview. [SEP] ( ap ) - a [SEP] + +===== sample 042 ===== +[CLS] mike adams, deputy superintendent mike o ' brien and barbara morgan, a fourth - grader. [SEP] all six men are out for about four weeks before a tour of australia, which he is scheduled to begin next year. [SEP] he can only drive in half - way, thinking of his mates and soon picks up a laptop and sits his sleep on the front floor of his bed. [SEP] £1. 99 - $ 0. 99 £199 ; www. £69. 99. [SEP] arsenal lost their fa cup final meeting at crystal palace on the night just 12 hours after liverpool made a play - off trip to tottenham hotspur. [SEP] + +===== sample 043 ===== +[CLS] [SEP] the company ' s executive director, mohammed gbadi, is a former employee. [SEP] but even if the crisis is not temporary, a run - up in prices is not the case. [SEP] the u. n. news agency reported sunday that the united states had " fully located " the missiles and were continuing to place them in the same location. [SEP] the council president, paul mason, demanded an " independent review " inquiry. [SEP] in his decision, judge phillips said that the us authorities had allowed any proceedings to proceed - - or out of court - - to be filed as quickly as a court suit was necessary. [SEP] [SEP] + +===== sample 044 ===== +[CLS], says the sheriff ' s office investigated the county ' s call after responding to an incident at home in sequito. [SEP] by the end of the year, a number of claims are expected to be 14, 000, officials said. [SEP] if this goes on forever, we are about to be forever locked in the bubble zone. [SEP] i don ' t think that is true - i know it was true and do not deny that. [SEP] keep being happy with him too. [SEP] i haven ' t heard anything about it. [SEP] but i was doing well.... not too fast. [SEP] robert burns, the former [SEP] + +===== sample 045 ===== +[CLS]ws. com. [SEP] the family sister, john johnson, said she had been called by the mother about a drunken incident. [SEP] that was normal. [SEP] " doing good is a different kind of sport. [SEP] president obama has stated in a speech that during former president bill clinton ' s administration, us president george bush would be " more than 100 days " for members of the military. [SEP] meanwhile, older people are leaving their parents in primary school or after their primary school or staying in over the summer or fall. [SEP] it is long enough for mitchell, who is not out until the game, but he made no secret of his [SEP] + +===== sample 046 ===== +[CLS] the league ' s first straight home title. [SEP] the fillings start at £2. 99, and are topped with wine. [SEP] you are a pretty good. [SEP] zelaya refused to run an interim government, following his initial stint as a spokesman in the army. [SEP] the matter is being investigated by parliamentary authorities. [SEP] this isn ' t culture at all, it is about politics. [SEP] he says he had a full set of symptoms, which required him to get the phone back to his doctor for several months. [SEP] " this previous decision, with the risk of a very bad pregnancy, could have had a significant impact, " [SEP] + +===== sample 047 ===== +[CLS] the report. [SEP] yet the vote could be a significant slowdown in a country which has fallen short of recession in public campaign promises. [SEP] when i come here i will travel with a new head coach. [SEP] bent, 27, joined the arsenal football side from blackburn almost almost a decade ago and has played major part in the club in the past. [SEP] the fire authority deferred that building works were still going on at its building site, but originally said no work would take place in the county. [SEP] sharif had already issued a list to run for musharraf, and says that he does not see that " presidential [SEP] + +===== sample 048 ===== +[CLS]. military says most of its soldiers, known as marine infantry, now has a 100 - strong operations base in iraq, but it maintains a special operations command there that includes more than 2, 000 marines ahead of a new american strategy in the south. [SEP] it ' s not the case in the real world. [SEP] even its problems have been a disappointment. [SEP] officers made the call to jackson within the first three minutes, the inquiry said. [SEP] for more information, visit http : / / www. cri. org. [SEP] he was free to be reached until less than a month ago. [SEP] since the current financial crisis, [SEP] + +===== sample 049 ===== +[CLS], a joint venture of cnn and several other media news agencies. [SEP] these include the royal national trust & trust ( 0172 72009 ) and the restoration trust from £975, 000. [SEP] the mayor says the scheme will allow candidates to be part in the national election contest. [SEP] " and many of them were found and shot in the head, causing no injuries. [SEP] many companies have built large operations, some have a small scale base in the uk. [SEP] they became interested in the case of a young pub worker who was jailed for murder. [SEP] " it ' s an extremely small process, not a big [SEP] + +===== sample 050 ===== +[CLS] than enough to win this year ' s general elections, the electorate will become critical to the president ' s plans. [SEP] american airlines chief executive scott tankleff said tuesday the company couldn ' t try to push back, and could not conclude a deal. [SEP] the new and current tests are expected to be published and published early next year. [SEP] the show will revert to its non - public location on " 60 minutes " in 2010. [SEP] she had only since been released from the hospital. [SEP] since we waited for three months, though, it probably won ' t be long. [SEP] it is believed her family had died, [SEP] + +===== sample 051 ===== +[CLS] people to any health centre. [SEP] in fact, the lower high court could not be said ; the chief chief justice should have been more cowed. [SEP] when a large number of his family were missing, the family bought a house and he was dead. [SEP] he was ordered held without bond and was returned to prison tuesday. [SEP] other senate members have expressed similar concerns. [SEP] along with a weak housing market, obama has argued for concessions on key parts of the proposed bill. [SEP] a seasoned brand manager, heinemann remains the company ' s leading on - line designer, overseeing all products. [SEP] " his family are not part [SEP] + +===== sample 052 ===== +[CLS] said. [SEP] by then, turns out, it had been smith ' s final game of the night, she sent him to high school and had his notebooks for sleep. [SEP] ms lyn jones said a number of local people had attended the council ' s meeting. [SEP] however, the bbc has no more details. [SEP] if they did agree, it will probably take another three months. [SEP] the russian defense department has said it is unlikely to make a " satisfactory approach " to the oil issue. [SEP] mr ward, 53, of sudbury, suffolk, is expected to be sentenced at the city of norwich magistrates court in norwich on [SEP] + +===== sample 053 ===== +[CLS]. [SEP] his fault? [SEP] if we change the constitution, the situation will change, " he said. [SEP] in that way, they ' d better take responsibility for that this attack took place. [SEP] the air force national survey service said after three hours there had been no reports of uproar on land, with up to 20 trapped people still in the area. [SEP] the independent police complaints commission said the force had " received no reports of a conflict of public interest. " [SEP] the first is you can make your decision, even when you slow down. [SEP] the speed of the new system needs to be measured in order to create [SEP] + +===== sample 054 ===== +[CLS] the authorities in dealing with such a situation. [SEP] set in the aftermath of the cold war in 1980. [SEP] some companies do not have clear policies to set their profit targets. [SEP] the show creators wanted to write a playlist and did not want to write them in the short iterations of their original series. [SEP] the council has imposed a penalty of 30 months, a ban usually imposed, after completing its three - year extension earlier this month. [SEP] the plane was left on the fifth floor of the hotel and exited in front of the crowd. [SEP] he said he believes new information will be used for prevention. [SEP] the car, [SEP] + +===== sample 055 ===== +[CLS]q ). [SEP] shortly after american officials called to help, the bombing victim was not named as his killer, only to be arrested in the killings. [SEP] however, western officials said that at least four of the pakistani police had been killed, including 10 militants. [SEP] they said he claimed to have the victim shot outside the house monday night and that the rampage ended with his father ' s death. [SEP] it ' s difficult to gauge, " he says. [SEP] judge stephen j. kagan, the assistant commissioner of alaska, is the former assistant california attorney general for criminal investigation. [SEP] he also said a full - duty police officer [SEP] + +===== sample 056 ===== +[CLS] that, probably because, ' oh, in order to do it i need a lot of money, i ' m sorry, and i feel that there is no disingenuous to have some kind words in my voice. [SEP] august 21 - 5 p. m., w. broad street society, 1, 14th street, east n. 1615. [SEP] in the years she married timothy gordon, he became a b. h. fan. [SEP] e. r. k. malek, who is a conservative activist, also has not been promoted. [SEP] " it ' s a long, a long week, " says [SEP] + +===== sample 057 ===== +[CLS] workers began taking off the syringes and other sprits - - including coffee sandwiches and christmas tree meals - - to take patients. [SEP] people who were asked to do so would have to register to post questions in an hour or so before the full details, call 0177 79707 or 01706 7300000. [SEP] it ' s a very serious issue. [SEP] for the moment, he is not quite convinced but he insists we are at big risk. [SEP] last week, the house ethics committee failed to rule on the allegations of money and, apparently to avoid it, passed ethics rules that would ban spending [SEP] + +===== sample 058 ===== +[CLS] value of the house ' s value. [SEP] well, says mr. rauf. [SEP] british energy finished up 6. 4 percent to 6, 952. 5p, while shares of gas rose 6. 5 percent to 2. 5p. [SEP] det con chris brown also said the court would know that mr smith had waited for the morning after the robbery before he appeared in court at the time of his death. [SEP] the last election elections for european parliament was held in 1991. [SEP] " this is not a moment we believe we are heading for, " he said. [SEP] police now know who has been killed, and even [SEP] + +===== sample 059 ===== +[CLS] negative effects of the financial crisis leads to higher demand for available money for education, health and anti - poverty treatment programs and other measures to finance prevention programs, the report added. [SEP] it wasn ' t a bad show either way, either. [SEP] bad debt was among the worst in the financial crisis. [SEP] last year e4, the uk ' s third - largest telephone provider, negotiated a 6 % cut in its fixed - rate contract with vodaq. [SEP] the use of electricity generates around 17 % of the world ' s power available abroad. [SEP] the first bombings, in which more than 20 percent of muslims were killed in [SEP] + +===== sample 060 ===== +[CLS] to leave him while he would take part in the games. [SEP] the georgian commander, alexander kalirad, said the russian force had started a major offensive in the south osh region, advancing georgian anti - aircraft troops. [SEP] the means that patients may be prepared for further treatment - - - such as a longer hospital waiting period - - is not available, either 10 to 18 or 20 months after or nine months after surgery or diagnosis. [SEP] after all, he was competing at twickenham with david smith in 2002, after impressing in a dramatic final victory 27 years ago. [SEP] " a proposed human rights commission is the way [SEP] + +===== sample 061 ===== +[CLS] new election would be held every seven years. [SEP] this year, there were other drops in oil production prices, including in nigeria and in the us, the group said. [SEP] wednesday ' s record price was $ 2. 5 million. [SEP] a 64 - year - old welsh man has died in critical condition after being hit by a car in an accident on a bus in dorset. [SEP] the man was taken to southampton university hospital ' s emergency room four hours later, and is in hospital for further treatment. [SEP] the baltimore county police are investigating and investigating since 2003. [SEP] his focus will be on monday ' s performance and the return [SEP] + +===== sample 062 ===== +[CLS] the state ' s chief prosecutor has been suspended by the attorney general ' s office after holding an independent report of state sexual violations of state law enforcement law. [SEP] the chief general also named key figures, including lt. gen. mohammed zaqqani and abdul - qassim al - ahmadi, the deputy vice - chief of operations abdul - haq. [SEP] shortly after she was recorded on a radio station, the officers found documents she had cut down - - saying she had broken the stairs and was still gone. [SEP] she was the only back - sitter in the three women ' s skiing and world cup pairs events [SEP] + +===== sample 063 ===== +[CLS] 52. 1 percent for 2, 500 yards in the 2005 - 06 regular season. [SEP] the u. s. military closed the formal investigation into the cause of the shooting and turned it down. [SEP] the 61 - year - old was paid £21, 900 for his office expenses, rising to £91, 200, and £69, 560 for his home alone in march 2006 to £204, 997. [SEP] earlier, the company had confirmed cases of sanlulu1 : flu in asia, but it has ordered 2. 2 million pounds of high - grade bird sanlu, authorities said. [SEP] in [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/argmax_const1p45_noise_c256_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/argmax_const1p45_noise_c256_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..124e270539806f3f98c85cf42a21cae9ce7c5607 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/argmax_const1p45_noise_c256_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "argmax_const1p45_noise_c256", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "argmax_const1p45_noise_c256", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_cosine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "argmax", "final_temp": 1.0, "top_k": 0, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 1.0, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 43.01780486436395, "nll_per_token": 3.761614096604754, "tokens": 9644}, "diversity": {"sample_entropy": 4.198717295568989, "unique_tokens": 1974, "token_count": 8192, "distinct_1": 0.240966796875, "distinct_2": 0.7169045275590551, "top_token_mass": 0.0582275390625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world ' s biggest credit - card companies and stripped out $ 6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] \" we ' re very involved in policing schools, roads and buildings and we ' re working all over london to find incidents like this, \" he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon ' s appointment as a former u. n. [SEP]", "detok_text": "[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world's biggest credit - card companies and stripped out $6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] \"we're very involved in policing schools, roads and buildings and we're working all over london to find incidents like this,\" he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon's appointment as a former u. n. [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence ' s specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP]", "detok_text": "[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence's specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] wouldn ' t be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company ' s board voted overwhelmingly in support of president obama ' s plans in iraq for the next six months, leaving at least $ 200 billion over two months of war time. [SEP] no, he didn ' t know all the extra money. [SEP] the proposed changes would undermine the core of the state ' s constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP]", "detok_text": "[CLS] wouldn't be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company's board voted overwhelmingly in support of president obama's plans in iraq for the next six months, leaving at least $200 billion over two months of war time. [SEP] no, he didn't know all the extra money. [SEP] the proposed changes would undermine the core of the state's constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $ 3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel ( 020 78777 ; www. explore. co. uk ), revenue & customs holidays ( 020 730000 ) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP]", "detok_text": "[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel (020 78777; www. explore. co. uk), revenue & customs holidays (020 730000) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] \" the situation is that it will be improved, \" he said. [SEP] \" normally, ideally, people would see it later in the next month, doing it at least once a month, \" said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP]", "detok_text": "[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] \"the situation is that it will be improved,\" he said. [SEP] \"normally, ideally, people would see it later in the next month, doing it at least once a month,\" said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, \" and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff ' s department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP] \" it [SEP]", "detok_text": "[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, \"and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff's department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP]\" it [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] prosecutors in the mclelland case review the federal grand jury ' s findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government ' s last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can ' t imagine texting a baby, or [SEP]", "detok_text": "[CLS] prosecutors in the mclelland case review the federal grand jury's findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government's last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can't imagine texting a baby, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] receive a guaranteed bonus of $ 4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] \" i ' ll tell you today, he ' s much more effective than now. [SEP] these institutions are not entirely strangers ; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP]", "detok_text": "[CLS] receive a guaranteed bonus of $4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] \" i'll tell you today, he's much more effective than now. [SEP] these institutions are not entirely strangers; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] - of - one match to finish in the overall standings for the opening round. [SEP] leeds does not play its final home game after a 4 - 3 defeat to bohemians three days ago. [SEP] he refused to leave the post office until after april 2010 and will be able to announce details of his plans until the next year. [SEP] a 30 - year - old man has been bailed after a 22 - year - old man was found stabbed on london ' s regent street. [SEP] it is building a team of senior management and top financial advisors to take on the job. [SEP] but it is a turning point in the history of the [SEP]", "detok_text": "[CLS] - of - one match to finish in the overall standings for the opening round. [SEP] leeds does not play its final home game after a 4 - 3 defeat to bohemians three days ago. [SEP] he refused to leave the post office until after april 2010 and will be able to announce details of his plans until the next year. [SEP] a 30 - year - old man has been bailed after a 22 - year - old man was found stabbed on london's regent street. [SEP] it is building a team of senior management and top financial advisors to take on the job. [SEP] but it is a turning point in the history of the [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] county ' s emergency management office. [SEP] he told e - mails that the officers told him they had fired him, and after the officer got out of hand moved out and arrested the men. [SEP] it was not clear whether the case was being investigated before or whether prosecutors were due to court. [SEP] this is not the time for this fight. [SEP] that night, they had been locked up inside the club. [SEP] however, the report says that any changes should not stand in the way of the public inquiry and accountability for those claims. [SEP] and yet there is no point to think it irrationally. [SEP] installation is $ 29, [SEP]", "detok_text": "[CLS] county's emergency management office. [SEP] he told e - mails that the officers told him they had fired him, and after the officer got out of hand moved out and arrested the men. [SEP] it was not clear whether the case was being investigated before or whether prosecutors were due to court. [SEP] this is not the time for this fight. [SEP] that night, they had been locked up inside the club. [SEP] however, the report says that any changes should not stand in the way of the public inquiry and accountability for those claims. [SEP] and yet there is no point to think it irrationally. [SEP] installation is $29, [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] scientists at the national park are waiting to see if the virus replicates itself in the public. [SEP] james is hoping to force england into seventh place in his squad when he faces the world championships in rome later. [SEP] if you ' re young, light and clever, you ' ll just feel you ' re getting too tired of it. [SEP] the 12 - month growth rate slipped 0. 5 point to 7. 0 percent, which was down the 7. 5 percent expected in april. [SEP] bae could secure a £430m deal for the aegis helicopter system, which the u. s. air force is seeking to build [SEP]", "detok_text": "[CLS] scientists at the national park are waiting to see if the virus replicates itself in the public. [SEP] james is hoping to force england into seventh place in his squad when he faces the world championships in rome later. [SEP] if you're young, light and clever, you'll just feel you're getting too tired of it. [SEP] the 12 - month growth rate slipped 0. 5 point to 7. 0 percent, which was down the 7. 5 percent expected in april. [SEP] bae could secure a £430m deal for the aegis helicopter system, which the u. s. air force is seeking to build [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS]. [SEP] georgian officials also alleged that russian troops had carried out operations to disarm in south ossetia, which was the headquarters for u. s. and u. n. peacekeeping forces in afghanistan. [SEP] more recently, there was no immediate evidence to support the theory that the dead woman had been shot to flee the scene of the crime. [SEP] donaldsfeld, the vice president ' s science adviser and the chief executive of the joint national security council, is leading a research program at the national institute of economic studies. [SEP] the governor confirmed at a press news conference that the legislature approved the bill scheduled for march 1, [SEP]", "detok_text": "[CLS]. [SEP] georgian officials also alleged that russian troops had carried out operations to disarm in south ossetia, which was the headquarters for u. s. and u. n. peacekeeping forces in afghanistan. [SEP] more recently, there was no immediate evidence to support the theory that the dead woman had been shot to flee the scene of the crime. [SEP] donaldsfeld, the vice president's science adviser and the chief executive of the joint national security council, is leading a research program at the national institute of economic studies. [SEP] the governor confirmed at a press news conference that the legislature approved the bill scheduled for march 1, [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS] will never be stopped. [SEP] it ' s a place where people can spend time with a family, to keep the quiet. [SEP] the result is the level of support for the auto industry. [SEP] chrysler will have to make another reorganisation in its business units before the end of the year. [SEP] \" i think a lot more needs to be done for our national security, \" said alan ashburn, head of the congressional budget office. [SEP] it was the second of october - - almost six years ago when the iraqi police chief made the nomination for his job, announced at a meeting of the provincial council in the central square. [SEP] the [SEP]", "detok_text": "[CLS] will never be stopped. [SEP] it's a place where people can spend time with a family, to keep the quiet. [SEP] the result is the level of support for the auto industry. [SEP] chrysler will have to make another reorganisation in its business units before the end of the year. [SEP] \"i think a lot more needs to be done for our national security,\" said alan ashburn, head of the congressional budget office. [SEP] it was the second of october - - almost six years ago when the iraqi police chief made the nomination for his job, announced at a meeting of the provincial council in the central square. [SEP] the [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], including people in his family. [SEP] he moved out of san diego for his fourth - straight preseason game, going 3 - 1, to make the postseason the regular season. [SEP] mr power was the subject of a scandal in office last year but has said that he is helping with legal proceedings, despite facing impeachment proceedings and corruption charges. [SEP] if i hadn ' t held my son alive, the officers would probably very easily have done no harm, \" he added. [SEP] the hurricanes ' league most famous victory was a 5 - 4 thrasher on thursday night against nashville. [SEP] under new guidelines, health experts have failed to [SEP]", "detok_text": "[CLS], including people in his family. [SEP] he moved out of san diego for his fourth - straight preseason game, going 3 - 1, to make the postseason the regular season. [SEP] mr power was the subject of a scandal in office last year but has said that he is helping with legal proceedings, despite facing impeachment proceedings and corruption charges. [SEP] if i hadn't held my son alive, the officers would probably very easily have done no harm, \" he added. [SEP] the hurricanes' league most famous victory was a 5 - 4 thrasher on thursday night against nashville. [SEP] under new guidelines, health experts have failed to [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] for the first new session on the iranian crisis in four years, and threatened to hold talks in three days ' time without reaching a deal. [SEP] nobody wants a doctor to find the full x monitor to stay in the operating room. [SEP] brown, born in 1965 and once served at the u. s. army headquarters, initially received a brief b. d. in 1963 from the virginian university medical school, near the university of illinois law. [SEP] bank of america corp was selling a stake in a bank with net worth of $ 1. 8 billion to the u. s. u. s. federal reserve, the head of [SEP]", "detok_text": "[CLS] for the first new session on the iranian crisis in four years, and threatened to hold talks in three days' time without reaching a deal. [SEP] nobody wants a doctor to find the full x monitor to stay in the operating room. [SEP] brown, born in 1965 and once served at the u. s. army headquarters, initially received a brief b. d. in 1963 from the virginian university medical school, near the university of illinois law. [SEP] bank of america corp was selling a stake in a bank with net worth of $1. 8 billion to the u. s. u. s. federal reserve, the head of [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS] [SEP] he ' s free, but it won ' t work in his health either. [SEP] however, the imf ' s position has been to make it easier for banks to raise capital. [SEP] a government study found men working in apprenticeships were more likely to succeed those who left work just weeks after leaving for a formal appointment at the school year. [SEP] she said she thought she had to save her son, mr obama. [SEP] land securities said it would update its financial ratios during the third quarter of trading. [SEP] the boy did have two children but the parents said he did not want to attend a school which had children outside their [SEP]", "detok_text": "[CLS] [SEP] he's free, but it won't work in his health either. [SEP] however, the imf's position has been to make it easier for banks to raise capital. [SEP] a government study found men working in apprenticeships were more likely to succeed those who left work just weeks after leaving for a formal appointment at the school year. [SEP] she said she thought she had to save her son, mr obama. [SEP] land securities said it would update its financial ratios during the third quarter of trading. [SEP] the boy did have two children but the parents said he did not want to attend a school which had children outside their [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS]. bailoutreagh. com. [SEP] the average interest rate on the loan would be about $ 2. 60 to $ 3. 70 for the loan. [SEP] they go home and regularly sleep in a wheelchair, while 8 - year - old aaron and his mother take their son into the hospital, family and friends reported. [SEP] in a partly autobiographical account of david morrison ' s complicated life, he is best known to look at the best of his novels, including his novels as the boy ' s child, as well as as the original author of the children ' s story and \" dirty dancing \" writer david wells. [SEP] we [SEP]", "detok_text": "[CLS]. bailoutreagh. com. [SEP] the average interest rate on the loan would be about $2. 60 to $3. 70 for the loan. [SEP] they go home and regularly sleep in a wheelchair, while 8 - year - old aaron and his mother take their son into the hospital, family and friends reported. [SEP] in a partly autobiographical account of david morrison's complicated life, he is best known to look at the best of his novels, including his novels as the boy's child, as well as as the original author of the children's story and \"dirty dancing\" writer david wells. [SEP] we [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] open to the public in september. [SEP] the while the trade took place in the us, the fish were active in the 1980s and 1990s. [SEP] \" you can ' t have a budget because you know what you ' re going through - - you have a lot of money, and that ' s a lot of faith in the money, \" he said. [SEP] the first was the name of a former cargill employee. [SEP] but at some point he ' s got someone that has the same quality as everyone, and he has played well enough. [SEP] we could go to a very good hospital, \" he said. [SEP] \" we [SEP]", "detok_text": "[CLS] open to the public in september. [SEP] the while the trade took place in the us, the fish were active in the 1980s and 1990s. [SEP] \"you can't have a budget because you know what you're going through - - you have a lot of money, and that's a lot of faith in the money,\" he said. [SEP] the first was the name of a former cargill employee. [SEP] but at some point he's got someone that has the same quality as everyone, and he has played well enough. [SEP] we could go to a very good hospital, \"he said. [SEP]\" we [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS] [SEP] a zimbabwean military plane landed saturday just minutes after flying to the island 90 miles south of the capital on the coast of south africa. [SEP] in addition to being a senior striker, supported by harry redknapp, the spurs manager, who dismissed the idea that rooney alone, if he completed his first goal, he could be considered part of chelsea ' s top squads. [SEP] the fbi, the investigation unit, the office of the federal bureau of investigation and the fbi coordinate efforts in the investigation of the workplace violence. [SEP] bhp billiton has accepted the outcome in its own offer ahead of target of 3p for the [SEP]", "detok_text": "[CLS] [SEP] a zimbabwean military plane landed saturday just minutes after flying to the island 90 miles south of the capital on the coast of south africa. [SEP] in addition to being a senior striker, supported by harry redknapp, the spurs manager, who dismissed the idea that rooney alone, if he completed his first goal, he could be considered part of chelsea's top squads. [SEP] the fbi, the investigation unit, the office of the federal bureau of investigation and the fbi coordinate efforts in the investigation of the workplace violence. [SEP] bhp billiton has accepted the outcome in its own offer ahead of target of 3p for the [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] [SEP] palin said state law enforcement officers have complained about police complaints and the use of 24 - hour days of alerts that many have cancelled because of potential violations. [SEP] it was david smith in the first scottish national orchestra, north west scotland, who recorded the final part and composed franz zamlik ' s \" strange goodfellas. \" [SEP] appointments.. a good opportunity is available for real estate.... £262 - £24999 per annum + bonus.. british olympic association. leeds. £299 - - £26, 000 + bonus.. c £30000 per annum + bonus [SEP]", "detok_text": "[CLS] [SEP] palin said state law enforcement officers have complained about police complaints and the use of 24 - hour days of alerts that many have cancelled because of potential violations. [SEP] it was david smith in the first scottish national orchestra, north west scotland, who recorded the final part and composed franz zamlik's \"strange goodfellas.\" [SEP] appointments.. a good opportunity is available for real estate.... £262 - £24999 per annum + bonus.. british olympic association. leeds. £299 - - £26, 000 + bonus.. c £30000 per annum + bonus [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] over five years ago. [SEP] \" when i think that people would think about him is i ' ll ask for a pardon, you want to get your child out of a prison, you must be released, \" she said. [SEP] the national price rate is still at its highest level of inflation since 2001, but the government could afford to follow the record. [SEP] maj robert h. reid, head of britain ' s chief of naval staff, made an unprecedented appeal after five officers from the joint chiefs of staff were charged with an incident of suspected car theft. [SEP] the search is now way to determine the circumstances leading up to her death [SEP]", "detok_text": "[CLS] over five years ago. [SEP] \"when i think that people would think about him is i'll ask for a pardon, you want to get your child out of a prison, you must be released,\" she said. [SEP] the national price rate is still at its highest level of inflation since 2001, but the government could afford to follow the record. [SEP] maj robert h. reid, head of britain's chief of naval staff, made an unprecedented appeal after five officers from the joint chiefs of staff were charged with an incident of suspected car theft. [SEP] the search is now way to determine the circumstances leading up to her death [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] down in 2005, most local officials would not seem to wind up doing this job. [SEP] you ' ll do something you didn ' t do years ago. [SEP] a 4 - 0 champions league win, when they had only 15 players, ended their season in october 2009, and it took them to beat manchester united to get into the championship game. [SEP] china is the world ' s most important economy and it is expected to create hundreds of thousands of jobs around the world. [SEP] the man has been granted a bail order, but was later released on bail. [SEP] in fact, its geoclinist has become a popular instrument - [SEP]", "detok_text": "[CLS] down in 2005, most local officials would not seem to wind up doing this job. [SEP] you'll do something you didn't do years ago. [SEP] a 4 - 0 champions league win, when they had only 15 players, ended their season in october 2009, and it took them to beat manchester united to get into the championship game. [SEP] china is the world's most important economy and it is expected to create hundreds of thousands of jobs around the world. [SEP] the man has been granted a bail order, but was later released on bail. [SEP] in fact, its geoclinist has become a popular instrument - [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] change in performance or factors that could affect the company ' s current performance or we have to act on other statements of management to reflect future developments, the impact of pre - historical performance and performance, unexpected financial risks or events that could affect the accuracy or accuracy of the new information, potential criminal charges, regulations, or the interpretation of the information, or the public. [SEP] yahoo inc. amended its plan to combine yahoo with search ads in january, in a bid to modernize yahoo. [SEP] \" if patients are referred to an emergency, which is in a few hours, at the hospital after the onset of a flu outbreak, \" [SEP]", "detok_text": "[CLS] change in performance or factors that could affect the company's current performance or we have to act on other statements of management to reflect future developments, the impact of pre - historical performance and performance, unexpected financial risks or events that could affect the accuracy or accuracy of the new information, potential criminal charges, regulations, or the interpretation of the information, or the public. [SEP] yahoo inc. amended its plan to combine yahoo with search ads in january, in a bid to modernize yahoo. [SEP] \"if patients are referred to an emergency, which is in a few hours, at the hospital after the onset of a flu outbreak,\" [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS] said it was satisfied there is a \" serious flaw \" in the judges ' decisions. [SEP] in many cases, staff are usually forced to call in a telephone, but people complain and the numbers are always based on the call call. [SEP] in the past three years, the government, the federal police state council and the army were on track to launch new enforcement activities, according to the statement. [SEP] the court had permission for mr brown to turn the second session into a session but the end - of - session session was interrupted by his outburst. [SEP] she also has a large tricer in her headgegus. [SEP] following his long [SEP]", "detok_text": "[CLS] said it was satisfied there is a \"serious flaw\" in the judges' decisions. [SEP] in many cases, staff are usually forced to call in a telephone, but people complain and the numbers are always based on the call call. [SEP] in the past three years, the government, the federal police state council and the army were on track to launch new enforcement activities, according to the statement. [SEP] the court had permission for mr brown to turn the second session into a session but the end - of - session session was interrupted by his outburst. [SEP] she also has a large tricer in her headgegus. [SEP] following his long [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] prices. [SEP] one issue currently under discussion is allowing the house to pass legislation. [SEP] bernanke said the fed would cut rates and keep rates low through next sept. [SEP] the country is the no. 1 in india ' s developing economy, with exports falling under 21 percent of gdp in december of last year. [SEP] banksy, one of the leading british architects of the generation, worked for thirty years as a research assistant to the royal academy of music and to become a b lecturer and then associate professor of mathematics of the royal college society. [SEP] the children are usually too small or large for their jobs. [SEP] no action could [SEP]", "detok_text": "[CLS] prices. [SEP] one issue currently under discussion is allowing the house to pass legislation. [SEP] bernanke said the fed would cut rates and keep rates low through next sept. [SEP] the country is the no. 1 in india's developing economy, with exports falling under 21 percent of gdp in december of last year. [SEP] banksy, one of the leading british architects of the generation, worked for thirty years as a research assistant to the royal academy of music and to become a b lecturer and then associate professor of mathematics of the royal college society. [SEP] the children are usually too small or large for their jobs. [SEP] no action could [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the un security council approved the bill to question the legality of the constitution. [SEP] he said the metropolitan police police has launched an internal investigation into several county - level employees, including 10 officers who are disciplined and disciplined after complaints about officers while they carry out their duties. [SEP] it was in the five months before he went to college and arranged for her to enroll in college. [SEP] a resident dropped five to seven vases off the floor in the centre of the building. [SEP] the rate of weight loss increased from high levels - - 14 percent to 18 percent in 2001 and 2 percent in 2007, according to the research center. [SEP] [SEP]", "detok_text": "[CLS] the un security council approved the bill to question the legality of the constitution. [SEP] he said the metropolitan police police has launched an internal investigation into several county - level employees, including 10 officers who are disciplined and disciplined after complaints about officers while they carry out their duties. [SEP] it was in the five months before he went to college and arranged for her to enroll in college. [SEP] a resident dropped five to seven vases off the floor in the centre of the building. [SEP] the rate of weight loss increased from high levels - - 14 percent to 18 percent in 2001 and 2 percent in 2007, according to the research center. [SEP] [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS]. 500 in game three last sunday. [SEP] all three of those attacks have been linked to a terrorist network run by the american military, including the leader of al qaeda. [SEP] aerospace group boeing co. is expected to report disappointing full - year results and the outlook for its debt has sparked a steady stream of sales. [SEP] but the euro rose to 1. 6295 dollars from 1. 663. [SEP] this week ' s list included four schools, which received $ 1 million, six awards in 2006 and $ 3. 5 million in grants this year. [SEP] mr eide is iran ' s closest diplomat. [SEP] i still [SEP]", "detok_text": "[CLS]. 500 in game three last sunday. [SEP] all three of those attacks have been linked to a terrorist network run by the american military, including the leader of al qaeda. [SEP] aerospace group boeing co. is expected to report disappointing full - year results and the outlook for its debt has sparked a steady stream of sales. [SEP] but the euro rose to 1. 6295 dollars from 1. 663. [SEP] this week's list included four schools, which received $1 million, six awards in 2006 and $3. 5 million in grants this year. [SEP] mr eide is iran's closest diplomat. [SEP] i still [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS] critically injured in a series of attacks at a nightclub. [SEP] new home home secretary alan johnson has warned the government of the need for further legislation. [SEP] the state health department on thursday announced that legislation to change the amount of smoking is also pending. [SEP] a few of her students, aged in nursery class, did not have enough space to breathe. [SEP] the attack came after a security council report that the children were expelled from the foreign office in a government building. [SEP] wali ali, a former commander in the north, declined to be named, and said he was killed in the southern city. [SEP] he was only 20 years of [SEP]", "detok_text": "[CLS] critically injured in a series of attacks at a nightclub. [SEP] new home home secretary alan johnson has warned the government of the need for further legislation. [SEP] the state health department on thursday announced that legislation to change the amount of smoking is also pending. [SEP] a few of her students, aged in nursery class, did not have enough space to breathe. [SEP] the attack came after a security council report that the children were expelled from the foreign office in a government building. [SEP] wali ali, a former commander in the north, declined to be named, and said he was killed in the southern city. [SEP] he was only 20 years of [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] - section of congress. [SEP] mr clark has issued a statement for an public inquiry which is expected later. [SEP] miami, florida ( cnn ) - - the country ' s election commission rejected the military officers who had ousted the controversial \" military coup \" of president general pervez musharraf, the interim president said saturday. [SEP] however, while the us bank of bank of japan could cut rates today, a vice - chairman of the fed ' s policy committee said there had been no real sign of the recession. [SEP] richard davies, a fire service spokesman at south general nhs trust, said the service had been restored after the alarm [SEP]", "detok_text": "[CLS] - section of congress. [SEP] mr clark has issued a statement for an public inquiry which is expected later. [SEP] miami, florida (cnn) - - the country's election commission rejected the military officers who had ousted the controversial \"military coup\" of president general pervez musharraf, the interim president said saturday. [SEP] however, while the us bank of bank of japan could cut rates today, a vice - chairman of the fed's policy committee said there had been no real sign of the recession. [SEP] richard davies, a fire service spokesman at south general nhs trust, said the service had been restored after the alarm [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] ruled in his favor. [SEP] now we ' re facing the threat of a recession. [SEP] copper fell nearly 1. 8 per cent to $ 647, or 6. 9 per cent to $ 1, 007. 70. [SEP] the judge said the prosecution ' s case was adjourned until nov. [SEP] it says people should have the self - control experience to think and behave with a sense of normalness. [SEP] last night, the lakers had their best team to make it to the final four. [SEP] the details of the latest fight weren ' t immediately clear. [SEP] about 90 percent of the changes to the state ' [SEP]", "detok_text": "[CLS] ruled in his favor. [SEP] now we're facing the threat of a recession. [SEP] copper fell nearly 1. 8 per cent to $647, or 6. 9 per cent to $1, 007. 70. [SEP] the judge said the prosecution's case was adjourned until nov. [SEP] it says people should have the self - control experience to think and behave with a sense of normalness. [SEP] last night, the lakers had their best team to make it to the final four. [SEP] the details of the latest fight weren't immediately clear. [SEP] about 90 percent of the changes to the state ' [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS]25 or ( 888 ) 92720, u. s. dollars, or calling ( 0 ) 426 8106 or ( international ( 1 ) pass code 889981000 or pass code 20008. [SEP] the mod dismissed the increased claims of air strike orders, and added that it was reviewing procurement options on its current joint strike aircraft. [SEP] the federal trade commission has been set for an inquiry on whether to press charges. [SEP] and i was also holidaying in the family ' s holiday holiday home, which has vaulted ceilings, the hot weather, terraces and a roof. [SEP] john brown, the chairman [SEP]", "detok_text": "[CLS]25 or (888) 92720, u. s. dollars, or calling (0) 426 8106 or ( international (1) pass code 889981000 or pass code 20008. [SEP] the mod dismissed the increased claims of air strike orders, and added that it was reviewing procurement options on its current joint strike aircraft. [SEP] the federal trade commission has been set for an inquiry on whether to press charges. [SEP] and i was also holidaying in the family's holiday holiday home, which has vaulted ceilings, the hot weather, terraces and a roof. [SEP] john brown, the chairman [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] regiment took part in the military action of southern afghanistan. [SEP] former army commander lt. gen. keith pasquio, commander of the army ' s staff, said the war may be in need of an open debate between their commanders, including stanley mcchrystal and genel schwartz, the commander appointed by gen. george w. mcgeo, who was fired aug, to serve until his troops leave in august. [SEP] \" there ' s been some criticism over the last couple of months, and the state is not acting too much for me, \" he said. [SEP] the former president was nominated for the presidency in 1975 [SEP]", "detok_text": "[CLS] regiment took part in the military action of southern afghanistan. [SEP] former army commander lt. gen. keith pasquio, commander of the army's staff, said the war may be in need of an open debate between their commanders, including stanley mcchrystal and genel schwartz, the commander appointed by gen. george w. mcgeo, who was fired aug, to serve until his troops leave in august. [SEP] \"there's been some criticism over the last couple of months, and the state is not acting too much for me,\" he said. [SEP] the former president was nominated for the presidency in 1975 [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] series of flats on the fifth floor. [SEP] mr. jackson declined to acknowledge that jackson ' s death was delayed or his death would not be reported. [SEP] he said the unemployment rate dropped 4 percent on the year - - its highest - - since hitting 12. 2 percent in september 2006, about 7 : 30 p. m.. [SEP] to economists, the fedc was very much paying attention to the fact that the current financial market crisis was among the most serious and unprecedented in modern history. [SEP] the crowd was stunned by the size of the wall of the white house, but they didn ' t see the president, any more [SEP]", "detok_text": "[CLS] series of flats on the fifth floor. [SEP] mr. jackson declined to acknowledge that jackson's death was delayed or his death would not be reported. [SEP] he said the unemployment rate dropped 4 percent on the year - - its highest - - since hitting 12. 2 percent in september 2006, about 7: 30 p. m.. [SEP] to economists, the fedc was very much paying attention to the fact that the current financial market crisis was among the most serious and unprecedented in modern history. [SEP] the crowd was stunned by the size of the wall of the white house, but they didn't see the president, any more [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS] third quarter. [SEP] \" it is the duty to make the decisions of the game solely in the context of the legal and legal authorities and any information, or advice to any financial professional or authority, which may be appropriate to appeal. [SEP] last year nearly all of the country ' s 65 million people enrolled in their high education and many enrolled in the united states. [SEP] he was also jailed as a juvenile and given a discharge for his behaviour. [SEP] while sen clinton won nevada, he praised the party ' s decision to build a \" preliged voting base \" in the state primary for obama. [SEP] in the terms of the report [SEP]", "detok_text": "[CLS] third quarter. [SEP] \"it is the duty to make the decisions of the game solely in the context of the legal and legal authorities and any information, or advice to any financial professional or authority, which may be appropriate to appeal. [SEP] last year nearly all of the country's 65 million people enrolled in their high education and many enrolled in the united states. [SEP] he was also jailed as a juvenile and given a discharge for his behaviour. [SEP] while sen clinton won nevada, he praised the party's decision to build a\" preliged voting base \" in the state primary for obama. [SEP] in the terms of the report [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] language because it could not affect the tone of his speech. [SEP] the report came as the white house released a report that president obama will divert $ 35 billion a year from the stimulus program. [SEP] the company ' s third quarter net profit was $. 9 billion, on weakness in the u. s. and european markets. [SEP] many of the new visitors are in the united states. [SEP] texas tech has won three of its last four games in texas. [SEP] the majority dismissed the allegations against paterson, however, calling it a written question regarding the firing of a state ' s attorney. [SEP] they ' re looking for someone else, [SEP]", "detok_text": "[CLS] language because it could not affect the tone of his speech. [SEP] the report came as the white house released a report that president obama will divert $35 billion a year from the stimulus program. [SEP] the company's third quarter net profit was $. 9 billion, on weakness in the u. s. and european markets. [SEP] many of the new visitors are in the united states. [SEP] texas tech has won three of its last four games in texas. [SEP] the majority dismissed the allegations against paterson, however, calling it a written question regarding the firing of a state's attorney. [SEP] they're looking for someone else, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS] of former chief executive peter moore, pending the results of an internal review, the irb said in a statement on sunday. [SEP] but mr mukasey says that there are legal challenges to the idea that judges should be put in jeopardy. [SEP] the man could also have been jailed for 15 years. [SEP] in 1980 president george bush used the torch for a visit to the state ' s infantrymen ' s hospital, as well as the queen, to present his tribute to the service of victims during the vietnam war. [SEP] china ' s sovereign wealth market made an annual but record annual profit of rmb43bn in 2008 because of [SEP]", "detok_text": "[CLS] of former chief executive peter moore, pending the results of an internal review, the irb said in a statement on sunday. [SEP] but mr mukasey says that there are legal challenges to the idea that judges should be put in jeopardy. [SEP] the man could also have been jailed for 15 years. [SEP] in 1980 president george bush used the torch for a visit to the state's infantrymen's hospital, as well as the queen, to present his tribute to the service of victims during the vietnam war. [SEP] china's sovereign wealth market made an annual but record annual profit of rmb43bn in 2008 because of [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] an average of 8. 4 per cent over the next six months, with the biggest double - annual increase of 7 per since september 2006. [SEP] david marty served as deputy secretary of state for african affairs. [SEP] ryan taylor, 19, a doctor at the university hospital, died saturday, a day after he wrote out his crime. [SEP] it also makes illumine inc, the maker of alcoa inc., which also makes fermo ' s namesake coffees, and j. c. penn, the world ' s biggest - selling maker of consumer products used in its cars. [SEP] it was a decision i made [SEP]", "detok_text": "[CLS] an average of 8. 4 per cent over the next six months, with the biggest double - annual increase of 7 per since september 2006. [SEP] david marty served as deputy secretary of state for african affairs. [SEP] ryan taylor, 19, a doctor at the university hospital, died saturday, a day after he wrote out his crime. [SEP] it also makes illumine inc, the maker of alcoa inc., which also makes fermo's namesake coffees, and j. c. penn, the world's biggest - selling maker of consumer products used in its cars. [SEP] it was a decision i made [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] officer councillor jim porter said : \" i thought i made it the most obvious aspect of this situation after i was told it was a serious problem. [SEP] the lodge is currently open to all guests, and a hotel and other facilities have been available for the event, opening in november. [SEP] later wednesday, u. s. and coalition forces took control in western kunar province, which is near an important area where government troops operate. [SEP] president nawaz sharif ' s former deputy, muqtadah al - islami, and later the chief minister, gen. naqrq kayani will be vice president. [SEP] [SEP]", "detok_text": "[CLS] officer councillor jim porter said: \" i thought i made it the most obvious aspect of this situation after i was told it was a serious problem. [SEP] the lodge is currently open to all guests, and a hotel and other facilities have been available for the event, opening in november. [SEP] later wednesday, u. s. and coalition forces took control in western kunar province, which is near an important area where government troops operate. [SEP] president nawaz sharif's former deputy, muqtadah al - islami, and later the chief minister, gen. naqrq kayani will be vice president. [SEP] [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] have a lot of student children at college and my daughter at school, but probably because i will almost always get reminders of the alphabet at school rather than at school. [SEP] following a recent appearance by mrs. clinton, a former mr. obama and one colleague now appearing on state television, which calls mr. obama to be the vice president, said the 42 - year - old obama appeared safe. [SEP] she argued that she should be suspended by the national investigation and complaints commission, where she had been kept confidential and was not only allowed to under the rules of conduct, she did not need a formal investigation. [SEP] child and father [SEP]", "detok_text": "[CLS] have a lot of student children at college and my daughter at school, but probably because i will almost always get reminders of the alphabet at school rather than at school. [SEP] following a recent appearance by mrs. clinton, a former mr. obama and one colleague now appearing on state television, which calls mr. obama to be the vice president, said the 42 - year - old obama appeared safe. [SEP] she argued that she should be suspended by the national investigation and complaints commission, where she had been kept confidential and was not only allowed to under the rules of conduct, she did not need a formal investigation. [SEP] child and father [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] of the modern era. [SEP] police said the fifth child, briane mason, in the kitchen in clapham road, herts, suffered from a gastrointestinal complaint. [SEP] he said that it was good that some of the money would not be left in reserve. [SEP] \" it ' s a little hard for us to pay prices, \" she says. [SEP] most of all, i didn ' t drive three miles long before i could call a colleague to look up the phone. [SEP] take the \" top chef \" star tom watson, the show co - based based on the bbc ' s fourth book, the rules [SEP]", "detok_text": "[CLS] of the modern era. [SEP] police said the fifth child, briane mason, in the kitchen in clapham road, herts, suffered from a gastrointestinal complaint. [SEP] he said that it was good that some of the money would not be left in reserve. [SEP] \"it's a little hard for us to pay prices,\" she says. [SEP] most of all, i didn't drive three miles long before i could call a colleague to look up the phone. [SEP] take the \"top chef\" star tom watson, the show co - based based on the bbc's fourth book, the rules [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] town of perth and went missing on a sunday after a long holiday, the court heard. [SEP] the pentagon says at least 20, 000 people in excess of nearly 7 million people were killed in the war - - the largest toll of iraq ' s so long occupation and occupation of southern iraq. [SEP] in 2003, the city ' s financial planning board took up the application. [SEP] the former footballer david mercer has pleaded guilty to false suicide charges after being arrested and questioned on suspicion that she had been poisoned. [SEP] bolt would also secure a gold medal for 100m for american shawn johnson, who is third of the 100, 000m world [SEP]", "detok_text": "[CLS] town of perth and went missing on a sunday after a long holiday, the court heard. [SEP] the pentagon says at least 20, 000 people in excess of nearly 7 million people were killed in the war - - the largest toll of iraq's so long occupation and occupation of southern iraq. [SEP] in 2003, the city's financial planning board took up the application. [SEP] the former footballer david mercer has pleaded guilty to false suicide charges after being arrested and questioned on suspicion that she had been poisoned. [SEP] bolt would also secure a gold medal for 100m for american shawn johnson, who is third of the 100, 000m world [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] gas stations. [SEP] the u. s. department of energy had increased the total oil supply supply for processing by 1, 000 and 1, 000 bps. [SEP] that morning, officers said, officers arrived outside a nearby apartment building, which he thought closed because he was running a night ' s work. [SEP] \" it ' s changing. \" [SEP] john hogger was a member of labour ' s internal law inquiry committee and the former no. 2, john mcgrady, chair the public inquiry. [SEP] to give this, i sent notes to a visiting fellow teacher and asked for an interview. [SEP] ( ap ) - a [SEP]", "detok_text": "[CLS] gas stations. [SEP] the u. s. department of energy had increased the total oil supply supply for processing by 1, 000 and 1, 000 bps. [SEP] that morning, officers said, officers arrived outside a nearby apartment building, which he thought closed because he was running a night's work. [SEP] \"it's changing.\" [SEP] john hogger was a member of labour's internal law inquiry committee and the former no. 2, john mcgrady, chair the public inquiry. [SEP] to give this, i sent notes to a visiting fellow teacher and asked for an interview. [SEP] (ap) - a [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] mike adams, deputy superintendent mike o ' brien and barbara morgan, a fourth - grader. [SEP] all six men are out for about four weeks before a tour of australia, which he is scheduled to begin next year. [SEP] he can only drive in half - way, thinking of his mates and soon picks up a laptop and sits his sleep on the front floor of his bed. [SEP] £1. 99 - $ 0. 99 £199 ; www. £69. 99. [SEP] arsenal lost their fa cup final meeting at crystal palace on the night just 12 hours after liverpool made a play - off trip to tottenham hotspur. [SEP]", "detok_text": "[CLS] mike adams, deputy superintendent mike o' brien and barbara morgan, a fourth - grader. [SEP] all six men are out for about four weeks before a tour of australia, which he is scheduled to begin next year. [SEP] he can only drive in half - way, thinking of his mates and soon picks up a laptop and sits his sleep on the front floor of his bed. [SEP] £1. 99 - $0. 99 £199; www. £69. 99. [SEP] arsenal lost their fa cup final meeting at crystal palace on the night just 12 hours after liverpool made a play - off trip to tottenham hotspur. [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] [SEP] the company ' s executive director, mohammed gbadi, is a former employee. [SEP] but even if the crisis is not temporary, a run - up in prices is not the case. [SEP] the u. n. news agency reported sunday that the united states had \" fully located \" the missiles and were continuing to place them in the same location. [SEP] the council president, paul mason, demanded an \" independent review \" inquiry. [SEP] in his decision, judge phillips said that the us authorities had allowed any proceedings to proceed - - or out of court - - to be filed as quickly as a court suit was necessary. [SEP] [SEP]", "detok_text": "[CLS] [SEP] the company's executive director, mohammed gbadi, is a former employee. [SEP] but even if the crisis is not temporary, a run - up in prices is not the case. [SEP] the u. n. news agency reported sunday that the united states had \"fully located\" the missiles and were continuing to place them in the same location. [SEP] the council president, paul mason, demanded an \"independent review\" inquiry. [SEP] in his decision, judge phillips said that the us authorities had allowed any proceedings to proceed - - or out of court - - to be filed as quickly as a court suit was necessary. [SEP] [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS], says the sheriff ' s office investigated the county ' s call after responding to an incident at home in sequito. [SEP] by the end of the year, a number of claims are expected to be 14, 000, officials said. [SEP] if this goes on forever, we are about to be forever locked in the bubble zone. [SEP] i don ' t think that is true - i know it was true and do not deny that. [SEP] keep being happy with him too. [SEP] i haven ' t heard anything about it. [SEP] but i was doing well.... not too fast. [SEP] robert burns, the former [SEP]", "detok_text": "[CLS], says the sheriff's office investigated the county's call after responding to an incident at home in sequito. [SEP] by the end of the year, a number of claims are expected to be 14, 000, officials said. [SEP] if this goes on forever, we are about to be forever locked in the bubble zone. [SEP] i don't think that is true - i know it was true and do not deny that. [SEP] keep being happy with him too. [SEP] i haven't heard anything about it. [SEP] but i was doing well.... not too fast. [SEP] robert burns, the former [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS]ws. com. [SEP] the family sister, john johnson, said she had been called by the mother about a drunken incident. [SEP] that was normal. [SEP] \" doing good is a different kind of sport. [SEP] president obama has stated in a speech that during former president bill clinton ' s administration, us president george bush would be \" more than 100 days \" for members of the military. [SEP] meanwhile, older people are leaving their parents in primary school or after their primary school or staying in over the summer or fall. [SEP] it is long enough for mitchell, who is not out until the game, but he made no secret of his [SEP]", "detok_text": "[CLS]ws. com. [SEP] the family sister, john johnson, said she had been called by the mother about a drunken incident. [SEP] that was normal. [SEP] \"doing good is a different kind of sport. [SEP] president obama has stated in a speech that during former president bill clinton's administration, us president george bush would be\" more than 100 days \" for members of the military. [SEP] meanwhile, older people are leaving their parents in primary school or after their primary school or staying in over the summer or fall. [SEP] it is long enough for mitchell, who is not out until the game, but he made no secret of his [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] the league ' s first straight home title. [SEP] the fillings start at £2. 99, and are topped with wine. [SEP] you are a pretty good. [SEP] zelaya refused to run an interim government, following his initial stint as a spokesman in the army. [SEP] the matter is being investigated by parliamentary authorities. [SEP] this isn ' t culture at all, it is about politics. [SEP] he says he had a full set of symptoms, which required him to get the phone back to his doctor for several months. [SEP] \" this previous decision, with the risk of a very bad pregnancy, could have had a significant impact, \" [SEP]", "detok_text": "[CLS] the league's first straight home title. [SEP] the fillings start at £2. 99, and are topped with wine. [SEP] you are a pretty good. [SEP] zelaya refused to run an interim government, following his initial stint as a spokesman in the army. [SEP] the matter is being investigated by parliamentary authorities. [SEP] this isn't culture at all, it is about politics. [SEP] he says he had a full set of symptoms, which required him to get the phone back to his doctor for several months. [SEP] \"this previous decision, with the risk of a very bad pregnancy, could have had a significant impact,\" [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] the report. [SEP] yet the vote could be a significant slowdown in a country which has fallen short of recession in public campaign promises. [SEP] when i come here i will travel with a new head coach. [SEP] bent, 27, joined the arsenal football side from blackburn almost almost a decade ago and has played major part in the club in the past. [SEP] the fire authority deferred that building works were still going on at its building site, but originally said no work would take place in the county. [SEP] sharif had already issued a list to run for musharraf, and says that he does not see that \" presidential [SEP]", "detok_text": "[CLS] the report. [SEP] yet the vote could be a significant slowdown in a country which has fallen short of recession in public campaign promises. [SEP] when i come here i will travel with a new head coach. [SEP] bent, 27, joined the arsenal football side from blackburn almost almost a decade ago and has played major part in the club in the past. [SEP] the fire authority deferred that building works were still going on at its building site, but originally said no work would take place in the county. [SEP] sharif had already issued a list to run for musharraf, and says that he does not see that \" presidential [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. military says most of its soldiers, known as marine infantry, now has a 100 - strong operations base in iraq, but it maintains a special operations command there that includes more than 2, 000 marines ahead of a new american strategy in the south. [SEP] it ' s not the case in the real world. [SEP] even its problems have been a disappointment. [SEP] officers made the call to jackson within the first three minutes, the inquiry said. [SEP] for more information, visit http : / / www. cri. org. [SEP] he was free to be reached until less than a month ago. [SEP] since the current financial crisis, [SEP]", "detok_text": "[CLS]. military says most of its soldiers, known as marine infantry, now has a 100 - strong operations base in iraq, but it maintains a special operations command there that includes more than 2, 000 marines ahead of a new american strategy in the south. [SEP] it's not the case in the real world. [SEP] even its problems have been a disappointment. [SEP] officers made the call to jackson within the first three minutes, the inquiry said. [SEP] for more information, visit http://www. cri. org. [SEP] he was free to be reached until less than a month ago. [SEP] since the current financial crisis, [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS], a joint venture of cnn and several other media news agencies. [SEP] these include the royal national trust & trust ( 0172 72009 ) and the restoration trust from £975, 000. [SEP] the mayor says the scheme will allow candidates to be part in the national election contest. [SEP] \" and many of them were found and shot in the head, causing no injuries. [SEP] many companies have built large operations, some have a small scale base in the uk. [SEP] they became interested in the case of a young pub worker who was jailed for murder. [SEP] \" it ' s an extremely small process, not a big [SEP]", "detok_text": "[CLS], a joint venture of cnn and several other media news agencies. [SEP] these include the royal national trust & trust (0172 72009) and the restoration trust from £975, 000. [SEP] the mayor says the scheme will allow candidates to be part in the national election contest. [SEP] \"and many of them were found and shot in the head, causing no injuries. [SEP] many companies have built large operations, some have a small scale base in the uk. [SEP] they became interested in the case of a young pub worker who was jailed for murder. [SEP]\" it's an extremely small process, not a big [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] than enough to win this year ' s general elections, the electorate will become critical to the president ' s plans. [SEP] american airlines chief executive scott tankleff said tuesday the company couldn ' t try to push back, and could not conclude a deal. [SEP] the new and current tests are expected to be published and published early next year. [SEP] the show will revert to its non - public location on \" 60 minutes \" in 2010. [SEP] she had only since been released from the hospital. [SEP] since we waited for three months, though, it probably won ' t be long. [SEP] it is believed her family had died, [SEP]", "detok_text": "[CLS] than enough to win this year's general elections, the electorate will become critical to the president's plans. [SEP] american airlines chief executive scott tankleff said tuesday the company couldn't try to push back, and could not conclude a deal. [SEP] the new and current tests are expected to be published and published early next year. [SEP] the show will revert to its non - public location on \"60 minutes\" in 2010. [SEP] she had only since been released from the hospital. [SEP] since we waited for three months, though, it probably won't be long. [SEP] it is believed her family had died, [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] people to any health centre. [SEP] in fact, the lower high court could not be said ; the chief chief justice should have been more cowed. [SEP] when a large number of his family were missing, the family bought a house and he was dead. [SEP] he was ordered held without bond and was returned to prison tuesday. [SEP] other senate members have expressed similar concerns. [SEP] along with a weak housing market, obama has argued for concessions on key parts of the proposed bill. [SEP] a seasoned brand manager, heinemann remains the company ' s leading on - line designer, overseeing all products. [SEP] \" his family are not part [SEP]", "detok_text": "[CLS] people to any health centre. [SEP] in fact, the lower high court could not be said; the chief chief justice should have been more cowed. [SEP] when a large number of his family were missing, the family bought a house and he was dead. [SEP] he was ordered held without bond and was returned to prison tuesday. [SEP] other senate members have expressed similar concerns. [SEP] along with a weak housing market, obama has argued for concessions on key parts of the proposed bill. [SEP] a seasoned brand manager, heinemann remains the company's leading on - line designer, overseeing all products. [SEP] \" his family are not part [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] said. [SEP] by then, turns out, it had been smith ' s final game of the night, she sent him to high school and had his notebooks for sleep. [SEP] ms lyn jones said a number of local people had attended the council ' s meeting. [SEP] however, the bbc has no more details. [SEP] if they did agree, it will probably take another three months. [SEP] the russian defense department has said it is unlikely to make a \" satisfactory approach \" to the oil issue. [SEP] mr ward, 53, of sudbury, suffolk, is expected to be sentenced at the city of norwich magistrates court in norwich on [SEP]", "detok_text": "[CLS] said. [SEP] by then, turns out, it had been smith's final game of the night, she sent him to high school and had his notebooks for sleep. [SEP] ms lyn jones said a number of local people had attended the council's meeting. [SEP] however, the bbc has no more details. [SEP] if they did agree, it will probably take another three months. [SEP] the russian defense department has said it is unlikely to make a \"satisfactory approach\" to the oil issue. [SEP] mr ward, 53, of sudbury, suffolk, is expected to be sentenced at the city of norwich magistrates court in norwich on [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS]. [SEP] his fault? [SEP] if we change the constitution, the situation will change, \" he said. [SEP] in that way, they ' d better take responsibility for that this attack took place. [SEP] the air force national survey service said after three hours there had been no reports of uproar on land, with up to 20 trapped people still in the area. [SEP] the independent police complaints commission said the force had \" received no reports of a conflict of public interest. \" [SEP] the first is you can make your decision, even when you slow down. [SEP] the speed of the new system needs to be measured in order to create [SEP]", "detok_text": "[CLS]. [SEP] his fault? [SEP] if we change the constitution, the situation will change, \"he said. [SEP] in that way, they'd better take responsibility for that this attack took place. [SEP] the air force national survey service said after three hours there had been no reports of uproar on land, with up to 20 trapped people still in the area. [SEP] the independent police complaints commission said the force had\" received no reports of a conflict of public interest. \" [SEP] the first is you can make your decision, even when you slow down. [SEP] the speed of the new system needs to be measured in order to create [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] the authorities in dealing with such a situation. [SEP] set in the aftermath of the cold war in 1980. [SEP] some companies do not have clear policies to set their profit targets. [SEP] the show creators wanted to write a playlist and did not want to write them in the short iterations of their original series. [SEP] the council has imposed a penalty of 30 months, a ban usually imposed, after completing its three - year extension earlier this month. [SEP] the plane was left on the fifth floor of the hotel and exited in front of the crowd. [SEP] he said he believes new information will be used for prevention. [SEP] the car, [SEP]", "detok_text": "[CLS] the authorities in dealing with such a situation. [SEP] set in the aftermath of the cold war in 1980. [SEP] some companies do not have clear policies to set their profit targets. [SEP] the show creators wanted to write a playlist and did not want to write them in the short iterations of their original series. [SEP] the council has imposed a penalty of 30 months, a ban usually imposed, after completing its three - year extension earlier this month. [SEP] the plane was left on the fifth floor of the hotel and exited in front of the crowd. [SEP] he said he believes new information will be used for prevention. [SEP] the car, [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]q ). [SEP] shortly after american officials called to help, the bombing victim was not named as his killer, only to be arrested in the killings. [SEP] however, western officials said that at least four of the pakistani police had been killed, including 10 militants. [SEP] they said he claimed to have the victim shot outside the house monday night and that the rampage ended with his father ' s death. [SEP] it ' s difficult to gauge, \" he says. [SEP] judge stephen j. kagan, the assistant commissioner of alaska, is the former assistant california attorney general for criminal investigation. [SEP] he also said a full - duty police officer [SEP]", "detok_text": "[CLS]q ). [SEP] shortly after american officials called to help, the bombing victim was not named as his killer, only to be arrested in the killings. [SEP] however, western officials said that at least four of the pakistani police had been killed, including 10 militants. [SEP] they said he claimed to have the victim shot outside the house monday night and that the rampage ended with his father's death. [SEP] it's difficult to gauge, \" he says. [SEP] judge stephen j. kagan, the assistant commissioner of alaska, is the former assistant california attorney general for criminal investigation. [SEP] he also said a full - duty police officer [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] that, probably because, ' oh, in order to do it i need a lot of money, i ' m sorry, and i feel that there is no disingenuous to have some kind words in my voice. [SEP] august 21 - 5 p. m., w. broad street society, 1, 14th street, east n. 1615. [SEP] in the years she married timothy gordon, he became a b. h. fan. [SEP] e. r. k. malek, who is a conservative activist, also has not been promoted. [SEP] \" it ' s a long, a long week, \" says [SEP]", "detok_text": "[CLS] that, probably because, ' oh, in order to do it i need a lot of money, i'm sorry, and i feel that there is no disingenuous to have some kind words in my voice. [SEP] august 21 - 5 p. m., w. broad street society, 1, 14th street, east n. 1615. [SEP] in the years she married timothy gordon, he became a b. h. fan. [SEP] e. r. k. malek, who is a conservative activist, also has not been promoted. [SEP] \"it's a long, a long week,\" says [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] workers began taking off the syringes and other sprits - - including coffee sandwiches and christmas tree meals - - to take patients. [SEP] people who were asked to do so would have to register to post questions in an hour or so before the full details, call 0177 79707 or 01706 7300000. [SEP] it ' s a very serious issue. [SEP] for the moment, he is not quite convinced but he insists we are at big risk. [SEP] last week, the house ethics committee failed to rule on the allegations of money and, apparently to avoid it, passed ethics rules that would ban spending [SEP]", "detok_text": "[CLS] workers began taking off the syringes and other sprits - - including coffee sandwiches and christmas tree meals - - to take patients. [SEP] people who were asked to do so would have to register to post questions in an hour or so before the full details, call 0177 79707 or 01706 7300000. [SEP] it's a very serious issue. [SEP] for the moment, he is not quite convinced but he insists we are at big risk. [SEP] last week, the house ethics committee failed to rule on the allegations of money and, apparently to avoid it, passed ethics rules that would ban spending [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] value of the house ' s value. [SEP] well, says mr. rauf. [SEP] british energy finished up 6. 4 percent to 6, 952. 5p, while shares of gas rose 6. 5 percent to 2. 5p. [SEP] det con chris brown also said the court would know that mr smith had waited for the morning after the robbery before he appeared in court at the time of his death. [SEP] the last election elections for european parliament was held in 1991. [SEP] \" this is not a moment we believe we are heading for, \" he said. [SEP] police now know who has been killed, and even [SEP]", "detok_text": "[CLS] value of the house's value. [SEP] well, says mr. rauf. [SEP] british energy finished up 6. 4 percent to 6, 952. 5p, while shares of gas rose 6. 5 percent to 2. 5p. [SEP] det con chris brown also said the court would know that mr smith had waited for the morning after the robbery before he appeared in court at the time of his death. [SEP] the last election elections for european parliament was held in 1991. [SEP] \"this is not a moment we believe we are heading for,\" he said. [SEP] police now know who has been killed, and even [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] negative effects of the financial crisis leads to higher demand for available money for education, health and anti - poverty treatment programs and other measures to finance prevention programs, the report added. [SEP] it wasn ' t a bad show either way, either. [SEP] bad debt was among the worst in the financial crisis. [SEP] last year e4, the uk ' s third - largest telephone provider, negotiated a 6 % cut in its fixed - rate contract with vodaq. [SEP] the use of electricity generates around 17 % of the world ' s power available abroad. [SEP] the first bombings, in which more than 20 percent of muslims were killed in [SEP]", "detok_text": "[CLS] negative effects of the financial crisis leads to higher demand for available money for education, health and anti - poverty treatment programs and other measures to finance prevention programs, the report added. [SEP] it wasn't a bad show either way, either. [SEP] bad debt was among the worst in the financial crisis. [SEP] last year e4, the uk's third - largest telephone provider, negotiated a 6 % cut in its fixed - rate contract with vodaq. [SEP] the use of electricity generates around 17 % of the world's power available abroad. [SEP] the first bombings, in which more than 20 percent of muslims were killed in [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] to leave him while he would take part in the games. [SEP] the georgian commander, alexander kalirad, said the russian force had started a major offensive in the south osh region, advancing georgian anti - aircraft troops. [SEP] the means that patients may be prepared for further treatment - - - such as a longer hospital waiting period - - is not available, either 10 to 18 or 20 months after or nine months after surgery or diagnosis. [SEP] after all, he was competing at twickenham with david smith in 2002, after impressing in a dramatic final victory 27 years ago. [SEP] \" a proposed human rights commission is the way [SEP]", "detok_text": "[CLS] to leave him while he would take part in the games. [SEP] the georgian commander, alexander kalirad, said the russian force had started a major offensive in the south osh region, advancing georgian anti - aircraft troops. [SEP] the means that patients may be prepared for further treatment - - - such as a longer hospital waiting period - - is not available, either 10 to 18 or 20 months after or nine months after surgery or diagnosis. [SEP] after all, he was competing at twickenham with david smith in 2002, after impressing in a dramatic final victory 27 years ago. [SEP] \" a proposed human rights commission is the way [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] new election would be held every seven years. [SEP] this year, there were other drops in oil production prices, including in nigeria and in the us, the group said. [SEP] wednesday ' s record price was $ 2. 5 million. [SEP] a 64 - year - old welsh man has died in critical condition after being hit by a car in an accident on a bus in dorset. [SEP] the man was taken to southampton university hospital ' s emergency room four hours later, and is in hospital for further treatment. [SEP] the baltimore county police are investigating and investigating since 2003. [SEP] his focus will be on monday ' s performance and the return [SEP]", "detok_text": "[CLS] new election would be held every seven years. [SEP] this year, there were other drops in oil production prices, including in nigeria and in the us, the group said. [SEP] wednesday's record price was $2. 5 million. [SEP] a 64 - year - old welsh man has died in critical condition after being hit by a car in an accident on a bus in dorset. [SEP] the man was taken to southampton university hospital's emergency room four hours later, and is in hospital for further treatment. [SEP] the baltimore county police are investigating and investigating since 2003. [SEP] his focus will be on monday's performance and the return [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] the state ' s chief prosecutor has been suspended by the attorney general ' s office after holding an independent report of state sexual violations of state law enforcement law. [SEP] the chief general also named key figures, including lt. gen. mohammed zaqqani and abdul - qassim al - ahmadi, the deputy vice - chief of operations abdul - haq. [SEP] shortly after she was recorded on a radio station, the officers found documents she had cut down - - saying she had broken the stairs and was still gone. [SEP] she was the only back - sitter in the three women ' s skiing and world cup pairs events [SEP]", "detok_text": "[CLS] the state's chief prosecutor has been suspended by the attorney general's office after holding an independent report of state sexual violations of state law enforcement law. [SEP] the chief general also named key figures, including lt. gen. mohammed zaqqani and abdul - qassim al - ahmadi, the deputy vice - chief of operations abdul - haq. [SEP] shortly after she was recorded on a radio station, the officers found documents she had cut down - - saying she had broken the stairs and was still gone. [SEP] she was the only back - sitter in the three women's skiing and world cup pairs events [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] 52. 1 percent for 2, 500 yards in the 2005 - 06 regular season. [SEP] the u. s. military closed the formal investigation into the cause of the shooting and turned it down. [SEP] the 61 - year - old was paid £21, 900 for his office expenses, rising to £91, 200, and £69, 560 for his home alone in march 2006 to £204, 997. [SEP] earlier, the company had confirmed cases of sanlulu1 : flu in asia, but it has ordered 2. 2 million pounds of high - grade bird sanlu, authorities said. [SEP] in [SEP]", "detok_text": "[CLS] 52. 1 percent for 2, 500 yards in the 2005 - 06 regular season. [SEP] the u. s. military closed the formal investigation into the cause of the shooting and turned it down. [SEP] the 61 - year - old was paid £21, 900 for his office expenses, rising to £91, 200, and £69, 560 for his home alone in march 2006 to £204, 997. [SEP] earlier, the company had confirmed cases of sanlulu1: flu in asia, but it has ordered 2. 2 million pounds of high - grade bird sanlu, authorities said. [SEP] in [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/argmax_linear2to08_noise_c256_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/argmax_linear2to08_noise_c256_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..244265e8efeaae4ceeadfcf10da101920835265b --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/argmax_linear2to08_noise_c256_detok_raw_samples.txt @@ -0,0 +1,236 @@ +argmax_linear2to08_noise_c256_detok +{ + "type": "summary", + "name": "argmax_linear2to08_noise_c256", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "argmax_linear2to08_noise_c256", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "argmax", + "final_temp": 1.0, + "top_k": 0, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.59276914535052, + "nll_per_token": 3.862680840986954, + "tokens": 9687 + }, + "diversity": { + "sample_entropy": 4.213223813400032, + "unique_tokens": 1963, + "token_count": 8192, + "distinct_1": 0.2396240234375, + "distinct_2": 0.7229330708661418, + "top_token_mass": 0.060302734375 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] played in her first two games of her past six seasons for the 2008 u. s. olympic team. [SEP] she said rbs was also informed that he had failed to appear at the hearing and was unable to cooperate with a criminal witness. [SEP] future users will be able to use their free time on the new system as a service. [SEP] but for him and his life on the mobile phone, " it might have been impossible. [SEP] no civil action pending, but any assault will violate the law, unless the defendant is ordered by the police to appear in court before breaking the rules. [SEP] a £6. 2m order is [SEP] + +===== sample 009 ===== +[CLS] they have been arrested or face the threat of police action. [SEP] but it was not clear whether they would propose a freeze, as the depletion of supplies is thought to cover the full impact of the crisis. [SEP] nor was he even being ordered for a court hearing and refused to testify. [SEP] perhaps that is the time to send information. [SEP] that said, he will probably pick up a pair of horses for the calendar that ends several years later this year - - this time around. [SEP] mr. mulally has been appointed as deputy vice director for space and head of the defense department. [SEP] two police officers were killed [SEP] + +===== sample 010 ===== +[CLS] if they get access to their content, they can't continue to receive their own files. [SEP] mr mitchell was found found dead and lying alone in his cell before he went to his house on the street. [SEP] the world's leading markets are expected to show a further slowdown in the uk economy this year, slowing annual inflation and cutting rates at a rate of 5. 6 percent, to 5. 0 percent, 5. 5 percent and 10. 7 percent.. [SEP] with a shortfall of £1. 4m, brode council has gone on to buy a £10. 6m stake in londonderry council [SEP] + +===== sample 011 ===== +[CLS] [SEP] he said mr muti was shown during his family's appearance in court dressed in imitations of justice, police said. [SEP] gonzales, the attorney general, stripped of his post after he tried to defend himself by claiming the court's decision had backed a ruling upholding the social security act, which he called a hate - terrorism case. [SEP] the truth is that many men, women and men have brought guns to school in england have found it changed their lives. [SEP] but the world has always seemed like a lonely place in the end of their own lives. [SEP] authorities had been looking for five men, members of a [SEP] + +===== sample 012 ===== +[CLS] [SEP] the blue devils, confident of losing their tournament title to russia, the highest team in the world, are the favorites to meet south korea for the first time. [SEP] i have not done it for over five years and have thought of it for longer before the end of the year. [SEP] "you should not face attack because you believe you should protect national security," said sheikh karuat murubara, chairman of the board of the office of president omar vice - mohammed al - amin. [SEP] a police spokesman said the couple were found seriously injured in an old abbey, near bristol, in the bristol area. [SEP] the [SEP] + +===== sample 013 ===== +[CLS] 30 percent. [SEP] officials said the suspects reportedly were members of president obamaʼs military advisers and intelligence officers, as they became an important inter - intelligence committee on both civilian and military intelligence. [SEP] duffy was confirmed as interim legal counsel last week but has worked to win claims since the case began. [SEP] it is also calling for an inquiry into allegations of his conduct. [SEP] gen. b. powell and patrick leahy were also the key advisers, and john c. powell, the first secretary of state. [SEP] this was a cross - party human rights act was lost against them. [SEP] the panel is expected to conduct a full investigation [SEP] + +===== sample 014 ===== +[CLS] field in corton wells at about 2000 gmt on sunday but was taken to the royal hospital, the national ambulance service reported on saturday. [SEP] " if we can draw at the rate we can only pay for anything else more than 1, 000 a year. [SEP] eight years ago i was the victim of the weather. [SEP] the birmingham, ill., oct. company, the world's largest maker, reported net revenue of $2. 2 billion, with net income of $42. 2 billion and reported sales of $1. 4 billion over the weekend. [SEP] but a bit of public effort should be required, and [SEP] + +===== sample 015 ===== +[CLS] the women's us team had once again won the money and his chance after playing at the radega golf center. [SEP] previous research into the condition found no risk among the elderly, including a study that found men with high deficits were more than likely to weather the worst of the disease as age progressed. [SEP] the bird was found abandoned at about noon bst while it was in hospital where he is now ill. [SEP] shell has said it would discuss its finances according to the terms of the deal. [SEP] if it is a doubt, he may never take up the park's freedom tower, which overlooks the popular [SEP] + +===== sample 016 ===== +[CLS] the new members of the board of the national retailing association. [SEP] the fire started at about 150 yards, in the street and at the front, cars broke out in the back and the vehicles were blocked through the street. [SEP] ian, ian and their daughter, catherine, 35, married a year ago and were married with two children in scotland. [SEP] the bank is listed in news reports as the only bank bank to sell at 10 percent of its bank debt to around $2 million - - an increase of more than 30 % over 2009 and of some $1 million over the final quarter of last year. [SEP] she is an [SEP] + +===== sample 017 ===== +[CLS] longest - skid in a. a. l. history. [SEP] before the result, the two republican groups have threatened obama and bush. [SEP] but, he was told, he could not have trusted her because she saw him, and then he was abusive, just because he attempted to call her. [SEP] the record holder is competing in several different programs. [SEP] a spokesman for the ministry of defence said that commander general sir sir john richards sent out a letter in iraq. [SEP] under the new law which was introduced last year, the president must be removed from the chamber of a permanent cabinet. [SEP] a pentagon spokesman, kevin boyd, [SEP] + +===== sample 018 ===== +[CLS] families were affected by the virus. [SEP] just before 3 a. m., three dozen police officers were waiting for police to slow down. [SEP] the announcement will be a disappointment to the team of harry redknapp, the spurs manager. [SEP] wayne rooney took advantage in the late break with dim berbatov's second - half strike to have liverpool clear local rivals arsenal at the bottom of the home premier league and ferguson preparing for the prospect of liverpool's first home victory in the league. [SEP] mr martin, the new tory leader, has faced stinging criticism of its own position ahead of publication of the general power expenses [SEP] + +===== sample 019 ===== +[CLS] comment. [SEP] another former law enforcement official said stratton was helping the public and local authorities in case of wrongdoing allegations. [SEP] spend $1. 8m on the spot, download the first copy of it and buy the album. [SEP] "the aim is to avoid any public office that the cabinet uses on it," the prime minister said. [SEP] london (reuters) - european union's counter - piracy fighter jet forces in north america attacked pirates with russian military attack aircraft, the air force force said on saturday. [SEP] waterfield, 23, was sentenced dec. [SEP] the £35 million community - based centre [SEP] + +===== sample 020 ===== +[CLS] earlier this month and has killed hundreds of possibly thousands of people. [SEP] then there is one of those five appropriate options, no type of an appointment or appointment ahead of time, no immediate need to apply, or any bonus. [SEP] pre - cancer diagnosis and treatment are considered the best option. [SEP] following the tragic killing, sir michael hunter said, the police began an independent investigation into mr. silwood's death. [SEP] he died in his cot shortly after the murder of col jonathan james, of 2nd battalion the duke of lancaster regiment who was commander of the brigade at night. [SEP] meanwhile, five americans were sentenced to death [SEP] + +===== sample 021 ===== +[CLS] 3 per cent to 9p (down from 9. 9 per cent). " [SEP] we'll have something on this soon. [SEP] anyone could be prosecuted. [SEP] the club have breached their regulations if they have voted to hold matches at the club, while the club's owner is now allowing the club to kick off the championship match. [SEP] american briton dixon was placed second in the field in a event where his fellow team - mates, brian smith and mark mczaghe, did little to help, suffering in a crash on sunday. [SEP] second seed serena williams won the french open crown in her fourth appearance in [SEP] + +===== sample 022 ===== +[CLS] freddie mac said it will cut nearly 40 percent of its consumer mortgage business as it tries to suffer credit losses linked to the u. s. housing slump and troubled mortgage market. [SEP] such is this comment that i find myself very critical of them. [SEP] he is a strong critic of the leader, brendan nichols, the deputy secretary of the church of england. [SEP] a government watchdog has ordered its members to earn hundreds of thousands of pounds a year by using the electoral complaints commission to produce and publish a final report. [SEP] an injured man killed in a blaze at two houses in the street on tuesday night was reported by police as " [SEP] + +===== sample 023 ===== +[CLS] said it was satisfied there is a "public interest" in the patients' safety. [SEP] the report says that too many children take such trips to a school, with almost two thirds of primary schools aged more than 16 taking two and seven more children at the time the tests appeared on the local primary education system. [SEP] half of the prisoners were reported to the authorities, according to the spokesman. [SEP] during a senate hearing for mr. biden, he said he no longer believed that many members of the committee should be counted in his life. [SEP] she also produced a new first act in the talent show. [SEP] in the 1960s and [SEP] + +===== sample 024 ===== +[CLS] police. [SEP] ms davies currently appeared as a solo vocalist at the national symphony. [SEP] mosley has used all but the rest of his playing career during his five seasons to secure his first - team place with the national team. [SEP] at other points, fukuda attacked lee's support of south korea as a safe place for terrorists. [SEP] the ugandan branch of the ugandan national tv association still has a trading relationship with the phone for only two days, and a new zealand tv provider will offer $1. 5 for a monthly fee. [SEP] two boys aged 15 and 10 - year - old girl are arrested on suspicion [SEP] + +===== sample 025 ===== +[CLS] 00977 (international or 1 - 800 - 703 u. s. calls), or by dialing + 800 - 800 - 845 - 975. [SEP] wiltshire police have warned anyone who was in the car to make it a "safer vehicle." [SEP] a national trust public inquiry was formed into the matter after the man's death last year. [SEP] a private funeral service has been held in the town to mark the start of the assault. [SEP] he was inconspicuous to the boys - - he is the boy sitting in his room and starts sneaking him into the room in his family - - [SEP] + +===== sample 026 ===== +[CLS]pc decline in net profits during the trading after the company said that it would have to buy $800m of shares for $6bn on the back of its recent book - loss of $399m. [SEP] underlying profits fell to £14m per share for the first three of a year because of recession. [SEP] but it was 5 - 1 in beijing. [SEP] i tried to do it again. [SEP] this week's eight - day event, which costs $1 million per person, makes less than $1 million a month. [SEP] khamashov, a five - year president of the union, accused of running [SEP] + +===== sample 027 ===== +[CLS] [SEP] they proved her, she had made a real issue for the show, and put her on the air. [SEP] the times said the trust wanted a review of the new rules, but that were unlikely by the end of the commission's report, which will take this month. [SEP] officials said he received a camera and other equipment worth more than $30, 000, the austin (texas) - times reported. [SEP] the driver will receive a video camera from police before making their way to the compound. [SEP] his son, to be sure, long ago, was working in the gas fields. [SEP] it is only 20 minutes of [SEP] + +===== sample 028 ===== +[CLS] - finals. [SEP] the 35 - year - old was also named in the squad that went to the world championships and the olympic finals. [SEP] no matter, officers found the shooting suspect. [SEP] the former striker had held the job previously, as inter finished their first 11 months of having won their opening three matches, but this time they were at home after only three months at villa. [SEP] williamson, 56, became co - president of the university's college medical board in 2006. [SEP] it also changed his character. [SEP] richard coleman, a forest service spokesman in moorland, colorado, said the agency would be issuing an alert to [SEP] + +===== sample 029 ===== +[CLS] their lives ended in a state of fear - - but a fear of their death. [SEP] murray didn't reach the final set until beating rafael nadal, and replaced stammer in the subsequent first - round robin match. [SEP] the sub - bridge was closed to traffic until between 2200 and 1630 gmt, but the lorry section reopened at 0330 gmt and roads were closed at 08450. [SEP] the' united states economy' after 1980's enjoyed its fastest growth since 1996. [SEP] mr solanki has worked hard; he started recently. [SEP] a former member of the board of the department of [SEP] + +===== sample 030 ===== +[CLS], ballet, football, tennis and tennis, but what's the option? [SEP] and he was told by her, by the boy's 30 years later, that he was better off than the king. [SEP] president musharraf has installed the president of parliament as his replacement. [SEP] various reports, however, have been published by state media, saying the panel that prompted the inquiry would have to allow authorities to determine whether his wife was not on a flight. [SEP] dr edward kennedy, 79, the director general of the university and university society of england, had asked the committee to give their case to richard, the former [SEP] + +===== sample 031 ===== +[CLS] mice in a laboratory laboratory, where the levels of the chemicals were high in inducing patients to have high levels of energy. [SEP] obama pulled ahead of john mccain this week but his republican presidential primary set off a terror threat against him. [SEP] rooney was at his post in the second, giving them added entrae to their fifth league win of the season. [SEP] a few minutes, add coffee and water to boil, and that's not enough. [SEP] the death over the course of three months is only the second year of a death by a coroner. [SEP] this requires shareholders to consider the abortion of the board positions and [SEP] + +===== sample 032 ===== +[CLS] its military leadership during the political turmoil. [SEP] mr mcilvy has claimed mr straw's decision was based on his case. [SEP] the farm sector has laid off at least three of the rest of the year, and lost 35, 000 jobs in january, compared with three months ago of 58, 416, the survey said. [SEP] to date, no deaths caused by the disease are linked to the seasonal flu, which have already been made up by a common seasonal flu, in the winter of flu and the virus, to minimise the severity of its spread. [SEP] but, according to the daily news, he argues, [SEP] + +===== sample 033 ===== +[CLS] information not to be made in place of their judgment in connection to the police inquiry. [SEP] (ap) - president robert kennedy and former vice president david mceven plan on laboring their fight wednesday to broker a healthcare deal. [SEP] new zealand have not come too far from the tournament after winning six of their last eight, but at least the united states. [SEP] well, ever since there have been left over. [SEP] mr green was given evidence to the police by mr phillips, who said the "serious decision to issue a criminal warrant was a significant break" in the legal case for a public inquiry into the terms of the report [SEP] + +===== sample 034 ===== +[CLS] [SEP] "it seemed there were a number of people out there saying we were sitting at the bar with a friend," said hamlin. [SEP] the country's deval budget, meanwhile, urgently needs about $6. 1 billion a year, but most of the children in this year's budget get final treatment. [SEP] mody is part of the british football squad youth team and has been named as a likely player for scotland since december 2007. [SEP] " the federal court is violating a state law that barred the reading of a hunting law without a state's consent. [SEP] after a long, sometimes long war, [SEP] + +===== sample 035 ===== +[CLS] the world. [SEP] this did not involve any increased activity in the muscles as a part of the body's electrical structure. [SEP] but a judge ruled on monday that there were no differences in the fact that, within two days of his current release, the prisoner would have been eligible for immediate release. [SEP] in the past few weeks, the government has backed the scheme directly, calling for a return to a second choice of mortgage to replace loans made on a mortgage. [SEP] the board members are encouraged to take shares. [SEP] the company reopened in may after making an application on an untested application by the company. [SEP] as for [SEP] + +===== sample 036 ===== +[CLS] s. defense secretary robert gates said sunday he did not think u. s. troops might pull out of the military offensive in afghanistan because of the turmoil after the elections. [SEP] that may be the problem. [SEP] ryan reid, 19, 19, of coventry, was killed on saturday. [SEP] she also will have joined helen, grant, edward jones and jackie robinson as the last five winners of honours for her film, including the revival in a classic tv production. [SEP] king john c. kennedy, who in 1982 won the world's highest medal of human rights, died in 2007 at the age of 60. [SEP] mr wild was [SEP] + +===== sample 037 ===== +[CLS]. [SEP] nottinghamshire police said " it is believed that brown was not the main victim of this murder and officers found the victim of drink - driving. [SEP] while many patients are able to receive treatment, almost all are found to have been asleep when they are home, said hospital officials. [SEP] the euro fell to $1. 9203 yen and $1. 854, up from 1. 933. 95, compared to 0. 9204 pounds late on friday. [SEP] during that, all buildings that had been mortgaged were for value obligations. [SEP] he said the incident was not part of the investigation. [SEP] some [SEP] + +===== sample 038 ===== +[CLS] the best part of his life at home and his kids at school, but that his police will not arrest or search his students one day in the same week. [SEP] although opel, the world's second - largest maker of luxury cars, failed in cars and trucks for the year, sales rose 2. 8 percent, in the second quarter, despite a 3 percent profit drop compared with its figure in the same period the previous year. [SEP] the national army and air force said its soldiers had detected the explosion, but said it likely occurred on the outskirts of tewud gar, north of kabul. [SEP] matthew and father [SEP] + +===== sample 039 ===== +[CLS] of the mortgage interest bill, which could rise to 6. 5 per cent growth, are unlikely to have been affected by inflation in 2010, according to a bank of england monetary fund. [SEP] he said bp had used £1. 6 of the market every day for about a billion worth of tankers six years ago, and it had debts of tens of millions of dollars. [SEP] "the life on earth doesn't drive us up long until we rise again. [SEP]" we believe the protocols have been adapted and adapted to ensure patient safety and increase safety. [SEP] coffey also served on the university's investigations team in 1996 and [SEP] + +===== sample 040 ===== +[CLS] threat of weather warnings starting to grow more storms in the united states, experts say the storms are expected to kill at least 20, 000 people in europe and nearly 7 million people in britain and the world. [SEP] medvedev, nato's former president, was appointed sacked and in november 2007 won parliamentary backing for the province. [SEP] this was also not an issue. [SEP] the french center has been limited to 22 points in what is his last game. [SEP] anderson, who also came in at the start of his campaign as the leading man for the second world title last year, has won his 80th test after winning 18 games [SEP] + +===== sample 041 ===== +[CLS] gas stations. [SEP] a total of £1. 5 million homes had been built, and approval prices for new homes fell, rising by 31 %, to a record annual rate of almost £2 million, figures show. [SEP] he faces a formal hearing in the court after he denied having a relationship with the girl. [SEP] i get estate worth worth $100 million (about $100) and worth about $100 - $200 (£6. 97 billion), $3 billion ). [SEP] the fact, "house of the sky," a stunning venetian installation shot in the 15th century, is almost a world down the coast - a [SEP] + +===== sample 042 ===== +[CLS] by mps on the rules for mps' pay and the government has been expected to rule on holding an election on reform of the treaty within four weeks because the move is expected to trigger a sitting majority in the next parliament. [SEP] he can do this in the way i am thinking of it every day. [SEP] in contrast, the cost of each room was £12. 99 for three bed and breakfast available (£78 - £15/week). £69. 99. [SEP] john mccain was staging a morning rally at the house on the street in front of san angelo, a town of about 700. [SEP] but the [SEP] + +===== sample 043 ===== +[CLS]. [SEP] clearly, it's not similar to that in other parts of the world. [SEP] people who try to buy presents may be hard enough to resist, but it is too early to go down the traditional buying route, and drive up the price in future. [SEP] in my case, the couple would probably end up spending a year on a beach. [SEP] however, the committee has ruled that the bank should make a "thorough and strategic review," which the letter says, from a senior executive, would try to qualify for a higher position as it would be a chairman who acts more effectively than usual in the circumstances. [SEP] [SEP] + +===== sample 044 ===== +[CLS] and they had pretty much emphasised the moment of night. [SEP] the committee also said it "believed its demand to abide" by the rules meant that "although the independent panel is not considered to be effective, therefore, further action should occur if the internal levels of the inquiry are deemed to improve." [SEP] this morning, when attorney general a. b. i. cuomo, mr. cuomo and his attorney said that no one had been met with anyone who allowed a special criminal investigation to sneak out of albany. [SEP] now it's a week, north of the iraqi border. [SEP] while the fbu calls [SEP] + +===== sample 045 ===== +[CLS] public news organizations, including rtl, the sunday daily, which also has reported television and public comments about her mental health. [SEP] the chairman of the senate's intelligence, joe lieberman, r - mich., told cnn that as the author of an energy bill, he also assumed that president george bush would be "the first" democrat to sign the legislation. [SEP] he said: " without further incident, the incident took place in the street. [SEP] gary hooper came in on the wing and dived on to his replacement, stephen jones, who was struggling to make up the goal. [SEP] in a history of trial [SEP] + +===== sample 046 ===== +[CLS] cover of the paper, which is still mired in editorials about its old paper existence. [SEP] james o. m. cuomo, the head of the m. b. b., is a former attorney who was appointed as attorney general on september 18. [SEP] lombardi is now allied with arizona quarterback jeff brown, football's only other all - time rushing champion. [SEP] about 2, 000 cases a week, including 3, 000, have been made public after peaking to over 200 in april 2006. [SEP] what does marriage mean? [SEP] he believes that a strong case of that could have limited consequences between air and climate [SEP] + +===== sample 047 ===== +[CLS] the company and its private business as a result of its pension problems, a company which has lost 560 jobs since joining the mail in 2001. [SEP] the times speaks four times, and says it is prepared to sit out of its meeting all week but may not see an answer in the fall. [SEP] his force officers are not acting as it relates but colleagues in the unit will co - operate this investigation. [SEP] hundreds of calls are being made public about whether people should get immunity with h1n1, while the scottish government insists healthy people are no immunity for new h1n1, the health register reported. [SEP] but " the [SEP] + +===== sample 048 ===== +[CLS] sending him a question on the whole search process as he describes the "period of horse - trading." [SEP] she also said the current situation meant there would be "irresponsibility in the media." [SEP] new york (reuters) - yahoo inc's stock unit posted $15 billion in third - quarter profits, helped by a $900 - million charge on the buyback of shares of its stock, aon said wednesday. [SEP] in those days of political talks, of course, no one will get a call. [SEP] he says that is a tough call, but he hopes to drive in a few years. [SEP] [SEP] + +===== sample 049 ===== +[CLS] tax profits including a £25m increase of £35m. the book of acquisition of british national savings bank (rbs. l) is expected rise to £670m, also higher than profits. [SEP] that's up five, nine times its rate in the last three months. [SEP] she is accused of briefly working as a receptionist at a hotel, making no training. [SEP] the taliban have built their formidable insurgency attacks from the small city since the afghan national army took control of the surrounding district in 2001. [SEP] this appeared to be an important order, but it wasn't for most of us now. [SEP] in [SEP] + +===== sample 050 ===== +[CLS]. [SEP] several other people were injured after the killing, police said. [SEP] the office for national statistics reported inflation down to 5 % in a month last month. [SEP] metropolitan police officers have found out a video of the incident in stockdale, north yorkshire. [SEP] new york's sales fell by 8. 3 % in october compared to last year, the biggest monthly decline since washington recorded a large increase in national foreclosure activity. [SEP] her five - year - old son, paul, of norfolk, and her husband, michael smith, were found hanged in the same room. [SEP] mr. browder said, however, [SEP] + +===== sample 051 ===== +[CLS]ers were the most vulnerable. [SEP] "based on their second - half performance at the finals of world cup, they've been fantastic," he said in a news interview. [SEP] fort collins police said the suspect in the shooting, who was 16 or 21, was being held in the pinellas county jail on saturday. [SEP] other council members have called for new elections, observers say. [SEP] he is just one of 15 million who have been born since the civil war. [SEP] he led the game with nine points and ran in one of the longest running touchdown drives in franchise history. [SEP] " i have no intention to play against [SEP] + +===== sample 052 ===== +[CLS] said. [SEP] there are two of the fastest - growing lifestyle myths: that you can't get drunk by drinking, and even a beer when you can feel very uncomfortable. [SEP] this time, it can hit only about half a second. [SEP] that's a myth. [SEP] that is the cost of university fees. [SEP] " we believe emergency calls were taken immediately before the incident. [SEP] of those there are at least £4. 2bn in the red, with at least £7bn (£2bn) over the lifetime of retirement - funds valued at at least £15m and those worth more than £4. 6 [SEP] + +===== sample 053 ===== +[CLS]. [SEP] in 1998 chief executive sir john blavine, the finance chairman, became the bank's chief executive officer. [SEP] japan's anthony kim birdied the final two holes to finish on 70 for a six - under 66 and three back on joint second with match - up leader peter hanson and defending champion ben curtis in a five under total of 135. [SEP] according to the local police, the group has become a viisance during the four - week trip. [SEP] according to bbc america, a company of news corp, fox and the bbc, broadband worth millions of pounds as part of its broadband service. [SEP] he is [SEP] + +===== sample 054 ===== +[CLS] charges, was questioned by a judge monday whether they will be considered for custody in connection with the case. [SEP] some people remain in the hospital, the spokeswoman said. [SEP] the man was seen swimming around a virginia beach and then driving north of reno shortly before 5 a. m., the king county police said. [SEP] jones was banned from the track for four races this season, after having her three - year olympic ban imposed in october. [SEP] electronic games company is the leading leader in both video and online video games for the world. [SEP] however, he once admitted it would be difficult for patients. [SEP] some 35, [SEP] + +===== sample 055 ===== +[CLS] it had decided to sell north american operations and to re - pay down debt. [SEP] at least 38 people died - - 10 were injured, according to the television reports. [SEP] a number of crews were deployed during operation panther following a rescue operation in early 2007. [SEP] authorities said two police officers then fired a shot outside the house and killed her. [SEP] you start with an ins insurance company who' wants someone's health insurance and pays off the time. [SEP] as speaker, sir john stevens, the assistant chief of westminster, is the author of a book report for the speaker. [SEP] revenues also fell during the christmas trading period in [SEP] + +===== sample 056 ===== +[CLS] sabotage, or breach of law. "[SEP]" to ask if they can make their lists so they can't make taxes, ask them to give all the distorting information to a person who's in the limelight. [SEP] the company said it had "full potential" to take up a portion of its $240 million to $150 million. [SEP] in 2003, the air force gave up a survey of kennedy space center in washington. [SEP] as such there is unease that the government could face the prospect of running into a war with the government. [SEP] "it's just once in a long week," says [SEP] + +===== sample 057 ===== +[CLS] public office space, the national sports center and arts centre, and the construction of nearby parks and schools to popularise its large urban population. [SEP] if you can get ahead, or just live longer or get too short, exercise regularly. [SEP] the company also also increased its outstanding 877 shares at last trading friday, on march 31, when it was trading at $1. 10 a share in the first five days. [SEP] the jail chief was ordered to death by county investigators. [SEP] in the early years of the vietnam war, the u. s. military academy, for instance, questioned whether an army would be part of the [SEP] + +===== sample 058 ===== +[CLS] picture of the house's conditions. [SEP] so far, mr. musharraf has been on a caretaker schedule; it is expected to take effect as soon. [SEP] and there's a pretty little fear about commenting on any aspect of ms. palin's plans. [SEP] the wachovia industrial shares had lost 15 percent to close at y9. 70 and close at y236. 80. [SEP] standard chartered bought a 60 - 50 per cent share of hbos last year and raised an additional won1. 2bn in the recent rights rights issue. [SEP] " then i feel great - he can even [SEP] + +===== sample 059 ===== +[CLS] wife, hannah rohme, a former finance manager for the former senior vice president and vice president, brokered the deal. [SEP] of the teachers, the national association of teachers said 81 percent said they are raising children. [SEP] passengers can go to virgin 0845 01074 (022 4568. com), 0877 493 90386, bachaus (083 636 7997), or english 1 800 8002 for additional information. [SEP] some had left school, and they have not. [SEP] the first lady was to be the winner in august. [SEP] gordon davis is [SEP] + +===== sample 060 ===== +[CLS] that shows it has widespread and popular support in the country. [SEP] the review of the system was launched on friday night after martin johnson, the director of the police service, said: " when he is caught, the owner of the phone doesn't pay, as he is not bound by the rules. [SEP] my son, however, could not. [SEP] however, police said they were not aware that any firearms had been lost in the previous operation. [SEP] he was elected as rector of d. roosevelt university in 2002, and was made president of the church of england in 1997. [SEP] while a proposed human rights commission limits the number [SEP] + +===== sample 061 ===== +[CLS] of other teachers and students at the right levels are able to avoid long - lasting conflict, while many teachers fail to think of their own experiences in the classroom. [SEP] mr starkey became an assistant principal at the national theatre company, but now he has taken a part in several productions which have taken him three weeks of the course. [SEP] now the fed rate cuts have the fed lower its rate of meeting in january. [SEP] 6 - - the report follows a senate committee report released sunday that attorney general eric schadr improperly made his call for war in iraq. [SEP] his focus will be on people's performance and the results [SEP] + +===== sample 062 ===== +[CLS] after pakistan's supreme court suspended president, gen. pervez musharraf declared an election law law, saying he will continue as chief justice. [SEP] this case is only one of its kind at the royal society. [SEP] now, it's supposed to be a "mussy," live " game in a typical cold weather. [SEP] but musharraf declared that extending the warrants was not considered high enough. [SEP] i'm in the district. [SEP] despite the controversy, may said he believes bolt has not created a back - end formula to make the men's race. [SEP] he should have [SEP] + +===== sample 063 ===== +[CLS] be a good feeling. [SEP] just three years ago, he received a doctorate and was suspended from the school in january. [SEP] and the appeal of the appeal court has ruled that it could not not be completed without a trial - - and therefore the costs of the case. [SEP] but britain says the law was changed, giving british troops the right to seek to appeal life in judicial cases in other countries. [SEP] she was later pursued by a police officer who reportedly was later shot. [SEP] he said that spending before the planned general election would be held until 2010, one week after the election should take place in june next year. [SEP] in [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/argmax_linear2to08_noise_c256_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/argmax_linear2to08_noise_c256_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..283f6e64c3279d113fc710eba572b1c5942f22c8 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/argmax_linear2to08_noise_c256_raw_samples.txt @@ -0,0 +1,236 @@ +argmax_linear2to08_noise_c256 +{ + "type": "summary", + "name": "argmax_linear2to08_noise_c256", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "argmax_linear2to08_noise_c256", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "argmax", + "final_temp": 1.0, + "top_k": 0, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.59276914535052, + "nll_per_token": 3.862680840986954, + "tokens": 9687 + }, + "diversity": { + "sample_entropy": 4.213223813400032, + "unique_tokens": 1963, + "token_count": 8192, + "distinct_1": 0.2396240234375, + "distinct_2": 0.7229330708661418, + "top_token_mass": 0.060302734375 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] played in her first two games of her past six seasons for the 2008 u. s. olympic team. [SEP] she said rbs was also informed that he had failed to appear at the hearing and was unable to cooperate with a criminal witness. [SEP] future users will be able to use their free time on the new system as a service. [SEP] but for him and his life on the mobile phone, " it might have been impossible. [SEP] no civil action pending, but any assault will violate the law, unless the defendant is ordered by the police to appear in court before breaking the rules. [SEP] a £6. 2m order is [SEP] + +===== sample 009 ===== +[CLS] they have been arrested or face the threat of police action. [SEP] but it was not clear whether they would propose a freeze, as the depletion of supplies is thought to cover the full impact of the crisis. [SEP] nor was he even being ordered for a court hearing and refused to testify. [SEP] perhaps that is the time to send information. [SEP] that said, he will probably pick up a pair of horses for the calendar that ends several years later this year - - this time around. [SEP] mr. mulally has been appointed as deputy vice director for space and head of the defense department. [SEP] two police officers were killed [SEP] + +===== sample 010 ===== +[CLS] if they get access to their content, they can ' t continue to receive their own files. [SEP] mr mitchell was found found dead and lying alone in his cell before he went to his house on the street. [SEP] the world ' s leading markets are expected to show a further slowdown in the uk economy this year, slowing annual inflation and cutting rates at a rate of 5. 6 percent, to 5. 0 percent, 5. 5 percent and 10. 7 percent.. [SEP] with a shortfall of £1. 4m, brode council has gone on to buy a £10. 6m stake in londonderry council [SEP] + +===== sample 011 ===== +[CLS] [SEP] he said mr muti was shown during his family ' s appearance in court dressed in imitations of justice, police said. [SEP] gonzales, the attorney general, stripped of his post after he tried to defend himself by claiming the court ' s decision had backed a ruling upholding the social security act, which he called a hate - terrorism case. [SEP] the truth is that many men, women and men have brought guns to school in england have found it changed their lives. [SEP] but the world has always seemed like a lonely place in the end of their own lives. [SEP] authorities had been looking for five men, members of a [SEP] + +===== sample 012 ===== +[CLS] [SEP] the blue devils, confident of losing their tournament title to russia, the highest team in the world, are the favorites to meet south korea for the first time. [SEP] i have not done it for over five years and have thought of it for longer before the end of the year. [SEP] " you should not face attack because you believe you should protect national security, " said sheikh karuat murubara, chairman of the board of the office of president omar vice - mohammed al - amin. [SEP] a police spokesman said the couple were found seriously injured in an old abbey, near bristol, in the bristol area. [SEP] the [SEP] + +===== sample 013 ===== +[CLS] 30 percent. [SEP] officials said the suspects reportedly were members of president obamaʼs military advisers and intelligence officers, as they became an important inter - intelligence committee on both civilian and military intelligence. [SEP] duffy was confirmed as interim legal counsel last week but has worked to win claims since the case began. [SEP] it is also calling for an inquiry into allegations of his conduct. [SEP] gen. b. powell and patrick leahy were also the key advisers, and john c. powell, the first secretary of state. [SEP] this was a cross - party human rights act was lost against them. [SEP] the panel is expected to conduct a full investigation [SEP] + +===== sample 014 ===== +[CLS] field in corton wells at about 2000 gmt on sunday but was taken to the royal hospital, the national ambulance service reported on saturday. [SEP] " if we can draw at the rate we can only pay for anything else more than 1, 000 a year. [SEP] eight years ago i was the victim of the weather. [SEP] the birmingham, ill., oct. company, the world ' s largest maker, reported net revenue of $ 2. 2 billion, with net income of $ 42. 2 billion and reported sales of $ 1. 4 billion over the weekend. [SEP] but a bit of public effort should be required, and [SEP] + +===== sample 015 ===== +[CLS] the women ' s us team had once again won the money and his chance after playing at the radega golf center. [SEP] previous research into the condition found no risk among the elderly, including a study that found men with high deficits were more than likely to weather the worst of the disease as age progressed. [SEP] the bird was found abandoned at about noon bst while it was in hospital where he is now ill. [SEP] shell has said it would discuss its finances according to the terms of the deal. [SEP] if it is a doubt, he may never take up the park ' s freedom tower, which overlooks the popular [SEP] + +===== sample 016 ===== +[CLS] the new members of the board of the national retailing association. [SEP] the fire started at about 150 yards, in the street and at the front, cars broke out in the back and the vehicles were blocked through the street. [SEP] ian, ian and their daughter, catherine, 35, married a year ago and were married with two children in scotland. [SEP] the bank is listed in news reports as the only bank bank to sell at 10 percent of its bank debt to around $ 2 million - - an increase of more than 30 % over 2009 and of some $ 1 million over the final quarter of last year. [SEP] she is an [SEP] + +===== sample 017 ===== +[CLS] longest - skid in a. a. l. history. [SEP] before the result, the two republican groups have threatened obama and bush. [SEP] but, he was told, he could not have trusted her because she saw him, and then he was abusive, just because he attempted to call her. [SEP] the record holder is competing in several different programs. [SEP] a spokesman for the ministry of defence said that commander general sir sir john richards sent out a letter in iraq. [SEP] under the new law which was introduced last year, the president must be removed from the chamber of a permanent cabinet. [SEP] a pentagon spokesman, kevin boyd, [SEP] + +===== sample 018 ===== +[CLS] families were affected by the virus. [SEP] just before 3 a. m., three dozen police officers were waiting for police to slow down. [SEP] the announcement will be a disappointment to the team of harry redknapp, the spurs manager. [SEP] wayne rooney took advantage in the late break with dim berbatov ' s second - half strike to have liverpool clear local rivals arsenal at the bottom of the home premier league and ferguson preparing for the prospect of liverpool ' s first home victory in the league. [SEP] mr martin, the new tory leader, has faced stinging criticism of its own position ahead of publication of the general power expenses [SEP] + +===== sample 019 ===== +[CLS] comment. [SEP] another former law enforcement official said stratton was helping the public and local authorities in case of wrongdoing allegations. [SEP] spend $ 1. 8m on the spot, download the first copy of it and buy the album. [SEP] " the aim is to avoid any public office that the cabinet uses on it, " the prime minister said. [SEP] london ( reuters ) - european union ' s counter - piracy fighter jet forces in north america attacked pirates with russian military attack aircraft, the air force force said on saturday. [SEP] waterfield, 23, was sentenced dec. [SEP] the £35 million community - based centre [SEP] + +===== sample 020 ===== +[CLS] earlier this month and has killed hundreds of possibly thousands of people. [SEP] then there is one of those five appropriate options, no type of an appointment or appointment ahead of time, no immediate need to apply, or any bonus. [SEP] pre - cancer diagnosis and treatment are considered the best option. [SEP] following the tragic killing, sir michael hunter said, the police began an independent investigation into mr. silwood ' s death. [SEP] he died in his cot shortly after the murder of col jonathan james, of 2nd battalion the duke of lancaster regiment who was commander of the brigade at night. [SEP] meanwhile, five americans were sentenced to death [SEP] + +===== sample 021 ===== +[CLS] 3 per cent to 9p ( down from 9. 9 per cent ). " [SEP] we ' ll have something on this soon. [SEP] anyone could be prosecuted. [SEP] the club have breached their regulations if they have voted to hold matches at the club, while the club ' s owner is now allowing the club to kick off the championship match. [SEP] american briton dixon was placed second in the field in a event where his fellow team - mates, brian smith and mark mczaghe, did little to help, suffering in a crash on sunday. [SEP] second seed serena williams won the french open crown in her fourth appearance in [SEP] + +===== sample 022 ===== +[CLS] freddie mac said it will cut nearly 40 percent of its consumer mortgage business as it tries to suffer credit losses linked to the u. s. housing slump and troubled mortgage market. [SEP] such is this comment that i find myself very critical of them. [SEP] he is a strong critic of the leader, brendan nichols, the deputy secretary of the church of england. [SEP] a government watchdog has ordered its members to earn hundreds of thousands of pounds a year by using the electoral complaints commission to produce and publish a final report. [SEP] an injured man killed in a blaze at two houses in the street on tuesday night was reported by police as " [SEP] + +===== sample 023 ===== +[CLS] said it was satisfied there is a " public interest " in the patients ' safety. [SEP] the report says that too many children take such trips to a school, with almost two thirds of primary schools aged more than 16 taking two and seven more children at the time the tests appeared on the local primary education system. [SEP] half of the prisoners were reported to the authorities, according to the spokesman. [SEP] during a senate hearing for mr. biden, he said he no longer believed that many members of the committee should be counted in his life. [SEP] she also produced a new first act in the talent show. [SEP] in the 1960s and [SEP] + +===== sample 024 ===== +[CLS] police. [SEP] ms davies currently appeared as a solo vocalist at the national symphony. [SEP] mosley has used all but the rest of his playing career during his five seasons to secure his first - team place with the national team. [SEP] at other points, fukuda attacked lee ' s support of south korea as a safe place for terrorists. [SEP] the ugandan branch of the ugandan national tv association still has a trading relationship with the phone for only two days, and a new zealand tv provider will offer $ 1. 5 for a monthly fee. [SEP] two boys aged 15 and 10 - year - old girl are arrested on suspicion [SEP] + +===== sample 025 ===== +[CLS] 00977 ( international or 1 - 800 - 703 u. s. calls ), or by dialing + 800 - 800 - 845 - 975. [SEP] wiltshire police have warned anyone who was in the car to make it a " safer vehicle. " [SEP] a national trust public inquiry was formed into the matter after the man ' s death last year. [SEP] a private funeral service has been held in the town to mark the start of the assault. [SEP] he was inconspicuous to the boys - - he is the boy sitting in his room and starts sneaking him into the room in his family - - [SEP] + +===== sample 026 ===== +[CLS]pc decline in net profits during the trading after the company said that it would have to buy $ 800m of shares for $ 6bn on the back of its recent book - loss of $ 399m. [SEP] underlying profits fell to £14m per share for the first three of a year because of recession. [SEP] but it was 5 - 1 in beijing. [SEP] i tried to do it again. [SEP] this week ' s eight - day event, which costs $ 1 million per person, makes less than $ 1 million a month. [SEP] khamashov, a five - year president of the union, accused of running [SEP] + +===== sample 027 ===== +[CLS] [SEP] they proved her, she had made a real issue for the show, and put her on the air. [SEP] the times said the trust wanted a review of the new rules, but that were unlikely by the end of the commission ' s report, which will take this month. [SEP] officials said he received a camera and other equipment worth more than $ 30, 000, the austin ( texas ) - times reported. [SEP] the driver will receive a video camera from police before making their way to the compound. [SEP] his son, to be sure, long ago, was working in the gas fields. [SEP] it is only 20 minutes of [SEP] + +===== sample 028 ===== +[CLS] - finals. [SEP] the 35 - year - old was also named in the squad that went to the world championships and the olympic finals. [SEP] no matter, officers found the shooting suspect. [SEP] the former striker had held the job previously, as inter finished their first 11 months of having won their opening three matches, but this time they were at home after only three months at villa. [SEP] williamson, 56, became co - president of the university ' s college medical board in 2006. [SEP] it also changed his character. [SEP] richard coleman, a forest service spokesman in moorland, colorado, said the agency would be issuing an alert to [SEP] + +===== sample 029 ===== +[CLS] their lives ended in a state of fear - - but a fear of their death. [SEP] murray didn ' t reach the final set until beating rafael nadal, and replaced stammer in the subsequent first - round robin match. [SEP] the sub - bridge was closed to traffic until between 2200 and 1630 gmt, but the lorry section reopened at 0330 gmt and roads were closed at 08450. [SEP] the ' united states economy ' after 1980 ' s enjoyed its fastest growth since 1996. [SEP] mr solanki has worked hard ; he started recently. [SEP] a former member of the board of the department of [SEP] + +===== sample 030 ===== +[CLS], ballet, football, tennis and tennis, but what ' s the option? [SEP] and he was told by her, by the boy ' s 30 years later, that he was better off than the king. [SEP] president musharraf has installed the president of parliament as his replacement. [SEP] various reports, however, have been published by state media, saying the panel that prompted the inquiry would have to allow authorities to determine whether his wife was not on a flight. [SEP] dr edward kennedy, 79, the director general of the university and university society of england, had asked the committee to give their case to richard, the former [SEP] + +===== sample 031 ===== +[CLS] mice in a laboratory laboratory, where the levels of the chemicals were high in inducing patients to have high levels of energy. [SEP] obama pulled ahead of john mccain this week but his republican presidential primary set off a terror threat against him. [SEP] rooney was at his post in the second, giving them added entrae to their fifth league win of the season. [SEP] a few minutes, add coffee and water to boil, and that ' s not enough. [SEP] the death over the course of three months is only the second year of a death by a coroner. [SEP] this requires shareholders to consider the abortion of the board positions and [SEP] + +===== sample 032 ===== +[CLS] its military leadership during the political turmoil. [SEP] mr mcilvy has claimed mr straw ' s decision was based on his case. [SEP] the farm sector has laid off at least three of the rest of the year, and lost 35, 000 jobs in january, compared with three months ago of 58, 416, the survey said. [SEP] to date, no deaths caused by the disease are linked to the seasonal flu, which have already been made up by a common seasonal flu, in the winter of flu and the virus, to minimise the severity of its spread. [SEP] but, according to the daily news, he argues, [SEP] + +===== sample 033 ===== +[CLS] information not to be made in place of their judgment in connection to the police inquiry. [SEP] ( ap ) - president robert kennedy and former vice president david mceven plan on laboring their fight wednesday to broker a healthcare deal. [SEP] new zealand have not come too far from the tournament after winning six of their last eight, but at least the united states. [SEP] well, ever since there have been left over. [SEP] mr green was given evidence to the police by mr phillips, who said the " serious decision to issue a criminal warrant was a significant break " in the legal case for a public inquiry into the terms of the report [SEP] + +===== sample 034 ===== +[CLS] [SEP] " it seemed there were a number of people out there saying we were sitting at the bar with a friend, " said hamlin. [SEP] the country ' s deval budget, meanwhile, urgently needs about $ 6. 1 billion a year, but most of the children in this year ' s budget get final treatment. [SEP] mody is part of the british football squad youth team and has been named as a likely player for scotland since december 2007. [SEP] " the federal court is violating a state law that barred the reading of a hunting law without a state ' s consent. [SEP] after a long, sometimes long war, [SEP] + +===== sample 035 ===== +[CLS] the world. [SEP] this did not involve any increased activity in the muscles as a part of the body ' s electrical structure. [SEP] but a judge ruled on monday that there were no differences in the fact that, within two days of his current release, the prisoner would have been eligible for immediate release. [SEP] in the past few weeks, the government has backed the scheme directly, calling for a return to a second choice of mortgage to replace loans made on a mortgage. [SEP] the board members are encouraged to take shares. [SEP] the company reopened in may after making an application on an untested application by the company. [SEP] as for [SEP] + +===== sample 036 ===== +[CLS] s. defense secretary robert gates said sunday he did not think u. s. troops might pull out of the military offensive in afghanistan because of the turmoil after the elections. [SEP] that may be the problem. [SEP] ryan reid, 19, 19, of coventry, was killed on saturday. [SEP] she also will have joined helen, grant, edward jones and jackie robinson as the last five winners of honours for her film, including the revival in a classic tv production. [SEP] king john c. kennedy, who in 1982 won the world ' s highest medal of human rights, died in 2007 at the age of 60. [SEP] mr wild was [SEP] + +===== sample 037 ===== +[CLS]. [SEP] nottinghamshire police said " it is believed that brown was not the main victim of this murder and officers found the victim of drink - driving. [SEP] while many patients are able to receive treatment, almost all are found to have been asleep when they are home, said hospital officials. [SEP] the euro fell to $ 1. 9203 yen and $ 1. 854, up from 1. 933. 95, compared to 0. 9204 pounds late on friday. [SEP] during that, all buildings that had been mortgaged were for value obligations. [SEP] he said the incident was not part of the investigation. [SEP] some [SEP] + +===== sample 038 ===== +[CLS] the best part of his life at home and his kids at school, but that his police will not arrest or search his students one day in the same week. [SEP] although opel, the world ' s second - largest maker of luxury cars, failed in cars and trucks for the year, sales rose 2. 8 percent, in the second quarter, despite a 3 percent profit drop compared with its figure in the same period the previous year. [SEP] the national army and air force said its soldiers had detected the explosion, but said it likely occurred on the outskirts of tewud gar, north of kabul. [SEP] matthew and father [SEP] + +===== sample 039 ===== +[CLS] of the mortgage interest bill, which could rise to 6. 5 per cent growth, are unlikely to have been affected by inflation in 2010, according to a bank of england monetary fund. [SEP] he said bp had used £1. 6 of the market every day for about a billion worth of tankers six years ago, and it had debts of tens of millions of dollars. [SEP] " the life on earth doesn ' t drive us up long until we rise again. [SEP] " we believe the protocols have been adapted and adapted to ensure patient safety and increase safety. [SEP] coffey also served on the university ' s investigations team in 1996 and [SEP] + +===== sample 040 ===== +[CLS] threat of weather warnings starting to grow more storms in the united states, experts say the storms are expected to kill at least 20, 000 people in europe and nearly 7 million people in britain and the world. [SEP] medvedev, nato ' s former president, was appointed sacked and in november 2007 won parliamentary backing for the province. [SEP] this was also not an issue. [SEP] the french center has been limited to 22 points in what is his last game. [SEP] anderson, who also came in at the start of his campaign as the leading man for the second world title last year, has won his 80th test after winning 18 games [SEP] + +===== sample 041 ===== +[CLS] gas stations. [SEP] a total of £1. 5 million homes had been built, and approval prices for new homes fell, rising by 31 %, to a record annual rate of almost £2 million, figures show. [SEP] he faces a formal hearing in the court after he denied having a relationship with the girl. [SEP] i get estate worth worth $ 100 million ( about $ 100 ) and worth about $ 100 - $ 200 ( £6. 97 billion ), $ 3 billion ). [SEP] the fact, " house of the sky, " a stunning venetian installation shot in the 15th century, is almost a world down the coast - a [SEP] + +===== sample 042 ===== +[CLS] by mps on the rules for mps ' pay and the government has been expected to rule on holding an election on reform of the treaty within four weeks because the move is expected to trigger a sitting majority in the next parliament. [SEP] he can do this in the way i am thinking of it every day. [SEP] in contrast, the cost of each room was £12. 99 for three bed and breakfast available ( £78 - £15 / week ). £69. 99. [SEP] john mccain was staging a morning rally at the house on the street in front of san angelo, a town of about 700. [SEP] but the [SEP] + +===== sample 043 ===== +[CLS]. [SEP] clearly, it ' s not similar to that in other parts of the world. [SEP] people who try to buy presents may be hard enough to resist, but it is too early to go down the traditional buying route, and drive up the price in future. [SEP] in my case, the couple would probably end up spending a year on a beach. [SEP] however, the committee has ruled that the bank should make a " thorough and strategic review, " which the letter says, from a senior executive, would try to qualify for a higher position as it would be a chairman who acts more effectively than usual in the circumstances. [SEP] [SEP] + +===== sample 044 ===== +[CLS] and they had pretty much emphasised the moment of night. [SEP] the committee also said it " believed its demand to abide " by the rules meant that " although the independent panel is not considered to be effective, therefore, further action should occur if the internal levels of the inquiry are deemed to improve. " [SEP] this morning, when attorney general a. b. i. cuomo, mr. cuomo and his attorney said that no one had been met with anyone who allowed a special criminal investigation to sneak out of albany. [SEP] now it ' s a week, north of the iraqi border. [SEP] while the fbu calls [SEP] + +===== sample 045 ===== +[CLS] public news organizations, including rtl, the sunday daily, which also has reported television and public comments about her mental health. [SEP] the chairman of the senate ' s intelligence, joe lieberman, r - mich., told cnn that as the author of an energy bill, he also assumed that president george bush would be " the first " democrat to sign the legislation. [SEP] he said : " without further incident, the incident took place in the street. [SEP] gary hooper came in on the wing and dived on to his replacement, stephen jones, who was struggling to make up the goal. [SEP] in a history of trial [SEP] + +===== sample 046 ===== +[CLS] cover of the paper, which is still mired in editorials about its old paper existence. [SEP] james o. m. cuomo, the head of the m. b. b., is a former attorney who was appointed as attorney general on september 18. [SEP] lombardi is now allied with arizona quarterback jeff brown, football ' s only other all - time rushing champion. [SEP] about 2, 000 cases a week, including 3, 000, have been made public after peaking to over 200 in april 2006. [SEP] what does marriage mean? [SEP] he believes that a strong case of that could have limited consequences between air and climate [SEP] + +===== sample 047 ===== +[CLS] the company and its private business as a result of its pension problems, a company which has lost 560 jobs since joining the mail in 2001. [SEP] the times speaks four times, and says it is prepared to sit out of its meeting all week but may not see an answer in the fall. [SEP] his force officers are not acting as it relates but colleagues in the unit will co - operate this investigation. [SEP] hundreds of calls are being made public about whether people should get immunity with h1n1, while the scottish government insists healthy people are no immunity for new h1n1, the health register reported. [SEP] but " the [SEP] + +===== sample 048 ===== +[CLS] sending him a question on the whole search process as he describes the " period of horse - trading. " [SEP] she also said the current situation meant there would be " irresponsibility in the media. " [SEP] new york ( reuters ) - yahoo inc ' s stock unit posted $ 15 billion in third - quarter profits, helped by a $ 900 - million charge on the buyback of shares of its stock, aon said wednesday. [SEP] in those days of political talks, of course, no one will get a call. [SEP] he says that is a tough call, but he hopes to drive in a few years. [SEP] [SEP] + +===== sample 049 ===== +[CLS] tax profits including a £25m increase of £35m. the book of acquisition of british national savings bank ( rbs. l ) is expected rise to £670m, also higher than profits. [SEP] that ' s up five, nine times its rate in the last three months. [SEP] she is accused of briefly working as a receptionist at a hotel, making no training. [SEP] the taliban have built their formidable insurgency attacks from the small city since the afghan national army took control of the surrounding district in 2001. [SEP] this appeared to be an important order, but it wasn ' t for most of us now. [SEP] in [SEP] + +===== sample 050 ===== +[CLS]. [SEP] several other people were injured after the killing, police said. [SEP] the office for national statistics reported inflation down to 5 % in a month last month. [SEP] metropolitan police officers have found out a video of the incident in stockdale, north yorkshire. [SEP] new york ' s sales fell by 8. 3 % in october compared to last year, the biggest monthly decline since washington recorded a large increase in national foreclosure activity. [SEP] her five - year - old son, paul, of norfolk, and her husband, michael smith, were found hanged in the same room. [SEP] mr. browder said, however, [SEP] + +===== sample 051 ===== +[CLS]ers were the most vulnerable. [SEP] " based on their second - half performance at the finals of world cup, they ' ve been fantastic, " he said in a news interview. [SEP] fort collins police said the suspect in the shooting, who was 16 or 21, was being held in the pinellas county jail on saturday. [SEP] other council members have called for new elections, observers say. [SEP] he is just one of 15 million who have been born since the civil war. [SEP] he led the game with nine points and ran in one of the longest running touchdown drives in franchise history. [SEP] " i have no intention to play against [SEP] + +===== sample 052 ===== +[CLS] said. [SEP] there are two of the fastest - growing lifestyle myths : that you can ' t get drunk by drinking, and even a beer when you can feel very uncomfortable. [SEP] this time, it can hit only about half a second. [SEP] that ' s a myth. [SEP] that is the cost of university fees. [SEP] " we believe emergency calls were taken immediately before the incident. [SEP] of those there are at least £4. 2bn in the red, with at least £7bn ( £2bn ) over the lifetime of retirement - funds valued at at least £15m and those worth more than £4. 6 [SEP] + +===== sample 053 ===== +[CLS]. [SEP] in 1998 chief executive sir john blavine, the finance chairman, became the bank ' s chief executive officer. [SEP] japan ' s anthony kim birdied the final two holes to finish on 70 for a six - under 66 and three back on joint second with match - up leader peter hanson and defending champion ben curtis in a five under total of 135. [SEP] according to the local police, the group has become a viisance during the four - week trip. [SEP] according to bbc america, a company of news corp, fox and the bbc, broadband worth millions of pounds as part of its broadband service. [SEP] he is [SEP] + +===== sample 054 ===== +[CLS] charges, was questioned by a judge monday whether they will be considered for custody in connection with the case. [SEP] some people remain in the hospital, the spokeswoman said. [SEP] the man was seen swimming around a virginia beach and then driving north of reno shortly before 5 a. m., the king county police said. [SEP] jones was banned from the track for four races this season, after having her three - year olympic ban imposed in october. [SEP] electronic games company is the leading leader in both video and online video games for the world. [SEP] however, he once admitted it would be difficult for patients. [SEP] some 35, [SEP] + +===== sample 055 ===== +[CLS] it had decided to sell north american operations and to re - pay down debt. [SEP] at least 38 people died - - 10 were injured, according to the television reports. [SEP] a number of crews were deployed during operation panther following a rescue operation in early 2007. [SEP] authorities said two police officers then fired a shot outside the house and killed her. [SEP] you start with an ins insurance company who ' wants someone ' s health insurance and pays off the time. [SEP] as speaker, sir john stevens, the assistant chief of westminster, is the author of a book report for the speaker. [SEP] revenues also fell during the christmas trading period in [SEP] + +===== sample 056 ===== +[CLS] sabotage, or breach of law. " [SEP] " to ask if they can make their lists so they can ' t make taxes, ask them to give all the distorting information to a person who ' s in the limelight. [SEP] the company said it had " full potential " to take up a portion of its $ 240 million to $ 150 million. [SEP] in 2003, the air force gave up a survey of kennedy space center in washington. [SEP] as such there is unease that the government could face the prospect of running into a war with the government. [SEP] " it ' s just once in a long week, " says [SEP] + +===== sample 057 ===== +[CLS] public office space, the national sports center and arts centre, and the construction of nearby parks and schools to popularise its large urban population. [SEP] if you can get ahead, or just live longer or get too short, exercise regularly. [SEP] the company also also increased its outstanding 877 shares at last trading friday, on march 31, when it was trading at $ 1. 10 a share in the first five days. [SEP] the jail chief was ordered to death by county investigators. [SEP] in the early years of the vietnam war, the u. s. military academy, for instance, questioned whether an army would be part of the [SEP] + +===== sample 058 ===== +[CLS] picture of the house ' s conditions. [SEP] so far, mr. musharraf has been on a caretaker schedule ; it is expected to take effect as soon. [SEP] and there ' s a pretty little fear about commenting on any aspect of ms. palin ' s plans. [SEP] the wachovia industrial shares had lost 15 percent to close at y9. 70 and close at y236. 80. [SEP] standard chartered bought a 60 - 50 per cent share of hbos last year and raised an additional won1. 2bn in the recent rights rights issue. [SEP] " then i feel great - he can even [SEP] + +===== sample 059 ===== +[CLS] wife, hannah rohme, a former finance manager for the former senior vice president and vice president, brokered the deal. [SEP] of the teachers, the national association of teachers said 81 percent said they are raising children. [SEP] passengers can go to virgin 0845 01074 ( 022 4568. com ), 0877 493 90386, bachaus ( 083 636 7997 ), or english 1 800 8002 for additional information. [SEP] some had left school, and they have not. [SEP] the first lady was to be the winner in august. [SEP] gordon davis is [SEP] + +===== sample 060 ===== +[CLS] that shows it has widespread and popular support in the country. [SEP] the review of the system was launched on friday night after martin johnson, the director of the police service, said : " when he is caught, the owner of the phone doesn ' t pay, as he is not bound by the rules. [SEP] my son, however, could not. [SEP] however, police said they were not aware that any firearms had been lost in the previous operation. [SEP] he was elected as rector of d. roosevelt university in 2002, and was made president of the church of england in 1997. [SEP] while a proposed human rights commission limits the number [SEP] + +===== sample 061 ===== +[CLS] of other teachers and students at the right levels are able to avoid long - lasting conflict, while many teachers fail to think of their own experiences in the classroom. [SEP] mr starkey became an assistant principal at the national theatre company, but now he has taken a part in several productions which have taken him three weeks of the course. [SEP] now the fed rate cuts have the fed lower its rate of meeting in january. [SEP] 6 - - the report follows a senate committee report released sunday that attorney general eric schadr improperly made his call for war in iraq. [SEP] his focus will be on people ' s performance and the results [SEP] + +===== sample 062 ===== +[CLS] after pakistan ' s supreme court suspended president, gen. pervez musharraf declared an election law law, saying he will continue as chief justice. [SEP] this case is only one of its kind at the royal society. [SEP] now, it ' s supposed to be a " mussy, " live " game in a typical cold weather. [SEP] but musharraf declared that extending the warrants was not considered high enough. [SEP] i ' m in the district. [SEP] despite the controversy, may said he believes bolt has not created a back - end formula to make the men ' s race. [SEP] he should have [SEP] + +===== sample 063 ===== +[CLS] be a good feeling. [SEP] just three years ago, he received a doctorate and was suspended from the school in january. [SEP] and the appeal of the appeal court has ruled that it could not not be completed without a trial - - and therefore the costs of the case. [SEP] but britain says the law was changed, giving british troops the right to seek to appeal life in judicial cases in other countries. [SEP] she was later pursued by a police officer who reportedly was later shot. [SEP] he said that spending before the planned general election would be held until 2010, one week after the election should take place in june next year. [SEP] in [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p12_top32_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p12_top32_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..6f23535d4adf69323305f6069e0c0f2f9034a98f --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p12_top32_detok_raw_samples.txt @@ -0,0 +1,236 @@ +const_thrs_tau0p12_top32_detok +{ + "type": "summary", + "name": "const_thrs_tau0p12_top32", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "const_thrs_tau0p12_top32", + "steps": 128, + "temp_start": 1.45, + "temp_end": 1.45, + "temp_schedule": "const", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_cosine", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.12, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 41.80839195562669, + "nll_per_token": 3.7330970838688944, + "tokens": 9725 + }, + "diversity": { + "sample_entropy": 4.204396875108297, + "unique_tokens": 1943, + "token_count": 8192, + "distinct_1": 0.2371826171875, + "distinct_2": 0.7140748031496063, + "top_token_mass": 0.0560302734375 + } +} + +===== sample 000 ===== +[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world's biggest credit - card companies and stripped out $6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] "we're very involved in policing schools, roads and buildings and we're working all over london to find incidents like this," he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon's appointment as a former u. n. [SEP] + +===== sample 001 ===== +[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence's specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP] + +===== sample 002 ===== +[CLS] wouldn't be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company's board voted overwhelmingly in support of president obama's plans in iraq for the next six months, leaving at least $200 billion over two months of war time. [SEP] no, he didn't know all the extra money. [SEP] the proposed changes would undermine the core of the state's constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP] + +===== sample 003 ===== +[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel (020 78777; www. explore. co. uk), revenue & customs holidays (020 730000) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP] + +===== sample 004 ===== +[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] "the situation is that it will be improved," he said. [SEP] "normally, ideally, people would see it later in the next month, doing it at least once a month," said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP] + +===== sample 005 ===== +[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, "and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff's department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP]" it [SEP] + +===== sample 006 ===== +[CLS] prosecutors in the mclelland case review the federal grand jury's findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government's last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can't imagine texting a baby, or [SEP] + +===== sample 007 ===== +[CLS] receive a guaranteed bonus of $4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] " i'll tell you today, he's much more effective than now. [SEP] these institutions are not entirely strangers; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP] + +===== sample 008 ===== +[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc (goo. o), microsoft corp (ms. n), google inc ( gooft. o, microsoft inc's top customer, and electric co inc (ge. nx: quote, profile, research, stock buzz) have announced plans to put net sales of $3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP] + +===== sample 009 ===== +[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister's home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually "on track" for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP] + +===== sample 010 ===== +[CLS] air, was deputy leader in russia's mi - 1 programme, and built russia's mirov ballistic missiles in addition to russia's first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama's 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP] + +===== sample 011 ===== +[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush's failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP] + +===== sample 012 ===== +[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won't be for long until you get water. [SEP] " the difference between being a husband and being a mother now is clear. [SEP] but what [SEP] + +===== sample 013 ===== +[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said: "this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department's report will not have historical significance and that" if law [SEP] + +===== sample 014 ===== +[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich's attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] " when a e - mail or email address is sent to someone at birth, which i don't know [SEP] + +===== sample 015 ===== +[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university's college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] "they want to... [SEP] he says that he" has a lot of great points, "but that he knows it is" very good " and does not believe this. [SEP] for all this time, it was in iceland's interest of nationalising its financial sector, and, of course, [SEP] + +===== sample 016 ===== +[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club's executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company's board, has made a $3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] " there is no sense [SEP] + +===== sample 017 ===== +[CLS] alaska's polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel's education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] " it's an early day [SEP] + +===== sample 018 ===== +[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP] + +===== sample 019 ===== +[CLS] rise of new zealand's fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he'd scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan's authorities are saying [SEP] + +===== sample 020 ===== +[CLS] public freedom. " [SEP] private sales opened last week at $12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that's what is an american school of american cooking, just as it's all about high - tech [SEP] + +===== sample 021 ===== +[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i'm a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP] + +===== sample 022 ===== +[CLS] be able to bring our soldiers into action, "said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said:" he's an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man's arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP] + +===== sample 023 ===== +[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs: hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP] + +===== sample 024 ===== +[CLS] williams, the club's executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell's attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] "we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving," he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP] + +===== sample 025 ===== +[CLS] by 10 per cent. [SEP] that's all even more so, in their view, as they don't speak to their children. [SEP] the lakers didn't risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder's two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP] + +===== sample 026 ===== +[CLS] up on his efforts to repeal the new people's law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant's main floor in the island's northern corner. [SEP] little rock, ark. [SEP] + +===== sample 027 ===== +[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it's not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world's top indian film director has taken charge of the country's budget, dropping his [SEP] + +===== sample 028 ===== +[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it's always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series; yes, he was [SEP] + +===== sample 029 ===== +[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john's was still buried long after his death in 2 1/2 years ago. [SEP] it is the final day of parliament and the prime minister's funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] (ap) - - craig johnson held up his lead and was good [SEP] + +===== sample 030 ===== +[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan's recent election, given " today's announcement that the taliban [SEP] + +===== sample 031 ===== +[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company's investor relations website (www. wthrewcorp. com) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP] + +===== sample 032 ===== +[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don't know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $100m through a payment system called the public service system ( csr [SEP] + +===== sample 033 ===== +[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP] + +===== sample 034 ===== +[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great "education." [SEP] i don't remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company's board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton's campaign [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] " you're not able to get work, you're out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP] + +===== sample 036 ===== +[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said: " it's a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai's brother, mr al - karzai's son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP] + +===== sample 038 ===== +[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP] + +===== sample 039 ===== +[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP] + +===== sample 040 ===== +[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP] + +===== sample 041 ===== +[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP] + +===== sample 042 ===== +[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] " i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP] + +===== sample 043 ===== +[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] "it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force's chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP]" those who know if there is any substance to this type of information were asked to back up up, " he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $1. 7 billion of gold on its reserves as china, the world's second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP] + +===== sample 045 ===== +[CLS] $80 to $90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country's parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there's also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin (d - mich.) said that it was time for barack obama to take his post as president. [SEP] he was [SEP] + +===== sample 046 ===== +[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $100, 000 and the current bonus package worth $250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that "direct complaints" were not made and the plant's co - operation had to be closed. [SEP] a strasbourg court [SEP] + +===== sample 047 ===== +[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] "we have already taken the measures to ensure the spread of flu is linked to improving care," the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP] + +===== sample 048 ===== +[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan's pashtun in the south. [SEP] "our manager's job to determine how it all happened to us," he said. [SEP] as one collector notes, "he's kept going away for just about five years," he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP] + +===== sample 049 ===== +[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin's 2008 vice presidential pick, launched a special inquiry into gov. palin's selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP] + +===== sample 050 ===== +[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden's speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey's " x [SEP] + +===== sample 051 ===== +[CLS] station, is to appear in magistrates' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] " the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let's not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i'm more likely to have been hit more than i ever thought. [SEP] the study also found [SEP] + +===== sample 053 ===== +[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it's like a movie she's made. [SEP] he also asked john mcguinner, the scottish government's executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday's fourth - quarter performance. [SEP] but if a baby dies a few [SEP] + +===== sample 054 ===== +[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes: joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service's office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP] + +===== sample 055 ===== +[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun's comments to north american scientists have long been consistent. [SEP] not so many americans [SEP] + +===== sample 056 ===== +[CLS] months. [SEP] in line with the national service's plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain's institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP] + +===== sample 057 ===== +[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house's roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP] + +===== sample 058 ===== +[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don't know - - or can't have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, "war on evil." [SEP] "you can see i had the car down on the back to myself. [SEP]" when [SEP] + +===== sample 059 ===== +[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year's pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world's new best - in - class car [SEP] + +===== sample 060 ===== +[CLS] t get enough to be angry, "he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase," long gone. " [SEP] in a [SEP] + +===== sample 061 ===== +[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain's air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] "despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits," said richard shepherd, the mpc's chief economist, [SEP] + +===== sample 062 ===== +[CLS]. [SEP] appearing in a programme - programme on bbc's morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king's college of new church in inverness and king's church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP] + +===== sample 063 ===== +[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn't he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke's successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p12_top32_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p12_top32_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..dbecca3ab1fde32f270184cf2459d1ff14454241 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p12_top32_raw_samples.txt @@ -0,0 +1,236 @@ +const_thrs_tau0p12_top32 +{ + "type": "summary", + "name": "const_thrs_tau0p12_top32", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "const_thrs_tau0p12_top32", + "steps": 128, + "temp_start": 1.45, + "temp_end": 1.45, + "temp_schedule": "const", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_cosine", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.12, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 41.80839195562669, + "nll_per_token": 3.7330970838688944, + "tokens": 9725 + }, + "diversity": { + "sample_entropy": 4.204396875108297, + "unique_tokens": 1943, + "token_count": 8192, + "distinct_1": 0.2371826171875, + "distinct_2": 0.7140748031496063, + "top_token_mass": 0.0560302734375 + } +} + +===== sample 000 ===== +[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world ' s biggest credit - card companies and stripped out $ 6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] " we ' re very involved in policing schools, roads and buildings and we ' re working all over london to find incidents like this, " he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon ' s appointment as a former u. n. [SEP] + +===== sample 001 ===== +[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence ' s specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP] + +===== sample 002 ===== +[CLS] wouldn ' t be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company ' s board voted overwhelmingly in support of president obama ' s plans in iraq for the next six months, leaving at least $ 200 billion over two months of war time. [SEP] no, he didn ' t know all the extra money. [SEP] the proposed changes would undermine the core of the state ' s constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP] + +===== sample 003 ===== +[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $ 3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel ( 020 78777 ; www. explore. co. uk ), revenue & customs holidays ( 020 730000 ) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP] + +===== sample 004 ===== +[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] " the situation is that it will be improved, " he said. [SEP] " normally, ideally, people would see it later in the next month, doing it at least once a month, " said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP] + +===== sample 005 ===== +[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, " and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff ' s department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP] " it [SEP] + +===== sample 006 ===== +[CLS] prosecutors in the mclelland case review the federal grand jury ' s findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government ' s last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can ' t imagine texting a baby, or [SEP] + +===== sample 007 ===== +[CLS] receive a guaranteed bonus of $ 4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] " i ' ll tell you today, he ' s much more effective than now. [SEP] these institutions are not entirely strangers ; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP] + +===== sample 008 ===== +[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc ( goo. o ), microsoft corp ( ms. n ), google inc ( gooft. o, microsoft inc ' s top customer, and electric co inc ( ge. nx : quote, profile, research, stock buzz ) have announced plans to put net sales of $ 3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP] + +===== sample 009 ===== +[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister ' s home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually " on track " for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP] + +===== sample 010 ===== +[CLS] air, was deputy leader in russia ' s mi - 1 programme, and built russia ' s mirov ballistic missiles in addition to russia ' s first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama ' s 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP] + +===== sample 011 ===== +[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush ' s failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP] + +===== sample 012 ===== +[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won ' t be for long until you get water. [SEP] " the difference between being a husband and being a mother now is clear. [SEP] but what [SEP] + +===== sample 013 ===== +[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said : " this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department ' s report will not have historical significance and that " if law [SEP] + +===== sample 014 ===== +[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich ' s attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] " when a e - mail or email address is sent to someone at birth, which i don ' t know [SEP] + +===== sample 015 ===== +[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university ' s college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] " they want to... [SEP] he says that he " has a lot of great points, " but that he knows it is " very good " and does not believe this. [SEP] for all this time, it was in iceland ' s interest of nationalising its financial sector, and, of course, [SEP] + +===== sample 016 ===== +[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club ' s executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company ' s board, has made a $ 3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] " there is no sense [SEP] + +===== sample 017 ===== +[CLS] alaska ' s polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel ' s education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] " it ' s an early day [SEP] + +===== sample 018 ===== +[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP] + +===== sample 019 ===== +[CLS] rise of new zealand ' s fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he ' d scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan ' s authorities are saying [SEP] + +===== sample 020 ===== +[CLS] public freedom. " [SEP] private sales opened last week at $ 12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that ' s what is an american school of american cooking, just as it ' s all about high - tech [SEP] + +===== sample 021 ===== +[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i ' m a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP] + +===== sample 022 ===== +[CLS] be able to bring our soldiers into action, " said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said : " he ' s an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man ' s arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP] + +===== sample 023 ===== +[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs : hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP] + +===== sample 024 ===== +[CLS] williams, the club ' s executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell ' s attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] " we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving, " he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP] + +===== sample 025 ===== +[CLS] by 10 per cent. [SEP] that ' s all even more so, in their view, as they don ' t speak to their children. [SEP] the lakers didn ' t risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder ' s two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP] + +===== sample 026 ===== +[CLS] up on his efforts to repeal the new people ' s law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant ' s main floor in the island ' s northern corner. [SEP] little rock, ark. [SEP] + +===== sample 027 ===== +[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it ' s not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world ' s top indian film director has taken charge of the country ' s budget, dropping his [SEP] + +===== sample 028 ===== +[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it ' s always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series ; yes, he was [SEP] + +===== sample 029 ===== +[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john ' s was still buried long after his death in 2 1 / 2 years ago. [SEP] it is the final day of parliament and the prime minister ' s funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] ( ap ) - - craig johnson held up his lead and was good [SEP] + +===== sample 030 ===== +[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan ' s recent election, given " today ' s announcement that the taliban [SEP] + +===== sample 031 ===== +[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company ' s investor relations website ( www. wthrewcorp. com ) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP] + +===== sample 032 ===== +[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don ' t know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $ 100m through a payment system called the public service system ( csr [SEP] + +===== sample 033 ===== +[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP] + +===== sample 034 ===== +[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great " education. " [SEP] i don ' t remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company ' s board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton ' s campaign [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] " you ' re not able to get work, you ' re out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP] + +===== sample 036 ===== +[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said : " it ' s a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai ' s brother, mr al - karzai ' s son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP] + +===== sample 038 ===== +[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP] + +===== sample 039 ===== +[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP] + +===== sample 040 ===== +[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP] + +===== sample 041 ===== +[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP] + +===== sample 042 ===== +[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] " i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP] + +===== sample 043 ===== +[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] " it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force ' s chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP] " those who know if there is any substance to this type of information were asked to back up up, " he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $ 1. 7 billion of gold on its reserves as china, the world ' s second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP] + +===== sample 045 ===== +[CLS] $ 80 to $ 90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country ' s parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there ' s also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin ( d - mich. ) said that it was time for barack obama to take his post as president. [SEP] he was [SEP] + +===== sample 046 ===== +[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $ 100, 000 and the current bonus package worth $ 250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that " direct complaints " were not made and the plant ' s co - operation had to be closed. [SEP] a strasbourg court [SEP] + +===== sample 047 ===== +[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] " we have already taken the measures to ensure the spread of flu is linked to improving care, " the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP] + +===== sample 048 ===== +[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan ' s pashtun in the south. [SEP] " our manager ' s job to determine how it all happened to us, " he said. [SEP] as one collector notes, " he ' s kept going away for just about five years, " he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP] + +===== sample 049 ===== +[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin ' s 2008 vice presidential pick, launched a special inquiry into gov. palin ' s selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP] + +===== sample 050 ===== +[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden ' s speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey ' s " x [SEP] + +===== sample 051 ===== +[CLS] station, is to appear in magistrates ' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] " the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let ' s not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i ' m more likely to have been hit more than i ever thought. [SEP] the study also found [SEP] + +===== sample 053 ===== +[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it ' s like a movie she ' s made. [SEP] he also asked john mcguinner, the scottish government ' s executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday ' s fourth - quarter performance. [SEP] but if a baby dies a few [SEP] + +===== sample 054 ===== +[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes : joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service ' s office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP] + +===== sample 055 ===== +[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun ' s comments to north american scientists have long been consistent. [SEP] not so many americans [SEP] + +===== sample 056 ===== +[CLS] months. [SEP] in line with the national service ' s plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain ' s institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP] + +===== sample 057 ===== +[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house ' s roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP] + +===== sample 058 ===== +[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don ' t know - - or can ' t have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, " war on evil. " [SEP] " you can see i had the car down on the back to myself. [SEP] " when [SEP] + +===== sample 059 ===== +[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year ' s pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world ' s new best - in - class car [SEP] + +===== sample 060 ===== +[CLS] t get enough to be angry, " he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants ' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase, " long gone. " [SEP] in a [SEP] + +===== sample 061 ===== +[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain ' s air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] " despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits, " said richard shepherd, the mpc ' s chief economist, [SEP] + +===== sample 062 ===== +[CLS]. [SEP] appearing in a programme - programme on bbc ' s morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king ' s college of new church in inverness and king ' s church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP] + +===== sample 063 ===== +[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn ' t he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke ' s successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p12_top32_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p12_top32_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..d93c3b6c36b6affde01cd86f7ef1e5b62ac3b314 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p12_top32_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "const_thrs_tau0p12_top32", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "const_thrs_tau0p12_top32", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_cosine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 32, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.12, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 41.80839195562669, "nll_per_token": 3.7330970838688944, "tokens": 9725}, "diversity": {"sample_entropy": 4.204396875108297, "unique_tokens": 1943, "token_count": 8192, "distinct_1": 0.2371826171875, "distinct_2": 0.7140748031496063, "top_token_mass": 0.0560302734375}} +{"type": "sample", "index": 0, "raw_text": "[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world ' s biggest credit - card companies and stripped out $ 6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] \" we ' re very involved in policing schools, roads and buildings and we ' re working all over london to find incidents like this, \" he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon ' s appointment as a former u. n. [SEP]", "detok_text": "[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world's biggest credit - card companies and stripped out $6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] \"we're very involved in policing schools, roads and buildings and we're working all over london to find incidents like this,\" he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon's appointment as a former u. n. [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence ' s specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP]", "detok_text": "[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence's specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] wouldn ' t be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company ' s board voted overwhelmingly in support of president obama ' s plans in iraq for the next six months, leaving at least $ 200 billion over two months of war time. [SEP] no, he didn ' t know all the extra money. [SEP] the proposed changes would undermine the core of the state ' s constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP]", "detok_text": "[CLS] wouldn't be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company's board voted overwhelmingly in support of president obama's plans in iraq for the next six months, leaving at least $200 billion over two months of war time. [SEP] no, he didn't know all the extra money. [SEP] the proposed changes would undermine the core of the state's constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $ 3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel ( 020 78777 ; www. explore. co. uk ), revenue & customs holidays ( 020 730000 ) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP]", "detok_text": "[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel (020 78777; www. explore. co. uk), revenue & customs holidays (020 730000) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] \" the situation is that it will be improved, \" he said. [SEP] \" normally, ideally, people would see it later in the next month, doing it at least once a month, \" said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP]", "detok_text": "[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] \"the situation is that it will be improved,\" he said. [SEP] \"normally, ideally, people would see it later in the next month, doing it at least once a month,\" said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, \" and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff ' s department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP] \" it [SEP]", "detok_text": "[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, \"and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff's department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP]\" it [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] prosecutors in the mclelland case review the federal grand jury ' s findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government ' s last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can ' t imagine texting a baby, or [SEP]", "detok_text": "[CLS] prosecutors in the mclelland case review the federal grand jury's findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government's last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can't imagine texting a baby, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] receive a guaranteed bonus of $ 4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] \" i ' ll tell you today, he ' s much more effective than now. [SEP] these institutions are not entirely strangers ; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP]", "detok_text": "[CLS] receive a guaranteed bonus of $4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] \" i'll tell you today, he's much more effective than now. [SEP] these institutions are not entirely strangers; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc ( goo. o ), microsoft corp ( ms. n ), google inc ( gooft. o, microsoft inc ' s top customer, and electric co inc ( ge. nx : quote, profile, research, stock buzz ) have announced plans to put net sales of $ 3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP]", "detok_text": "[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc (goo. o), microsoft corp (ms. n), google inc ( gooft. o, microsoft inc's top customer, and electric co inc (ge. nx: quote, profile, research, stock buzz) have announced plans to put net sales of $3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister ' s home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually \" on track \" for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP]", "detok_text": "[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister's home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually \"on track\" for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] air, was deputy leader in russia ' s mi - 1 programme, and built russia ' s mirov ballistic missiles in addition to russia ' s first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama ' s 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP]", "detok_text": "[CLS] air, was deputy leader in russia's mi - 1 programme, and built russia's mirov ballistic missiles in addition to russia's first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama's 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush ' s failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP]", "detok_text": "[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush's failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won ' t be for long until you get water. [SEP] \" the difference between being a husband and being a mother now is clear. [SEP] but what [SEP]", "detok_text": "[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won't be for long until you get water. [SEP] \" the difference between being a husband and being a mother now is clear. [SEP] but what [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said : \" this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department ' s report will not have historical significance and that \" if law [SEP]", "detok_text": "[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said: \"this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department's report will not have historical significance and that\" if law [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich ' s attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] \" when a e - mail or email address is sent to someone at birth, which i don ' t know [SEP]", "detok_text": "[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich's attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] \" when a e - mail or email address is sent to someone at birth, which i don't know [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university ' s college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] \" they want to... [SEP] he says that he \" has a lot of great points, \" but that he knows it is \" very good \" and does not believe this. [SEP] for all this time, it was in iceland ' s interest of nationalising its financial sector, and, of course, [SEP]", "detok_text": "[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university's college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] \"they want to... [SEP] he says that he\" has a lot of great points, \"but that he knows it is\" very good \" and does not believe this. [SEP] for all this time, it was in iceland's interest of nationalising its financial sector, and, of course, [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club ' s executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company ' s board, has made a $ 3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] \" there is no sense [SEP]", "detok_text": "[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club's executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company's board, has made a $3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] \" there is no sense [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] alaska ' s polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel ' s education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] \" it ' s an early day [SEP]", "detok_text": "[CLS] alaska's polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel's education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] \" it's an early day [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP]", "detok_text": "[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] rise of new zealand ' s fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he ' d scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan ' s authorities are saying [SEP]", "detok_text": "[CLS] rise of new zealand's fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he'd scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan's authorities are saying [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] public freedom. \" [SEP] private sales opened last week at $ 12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that ' s what is an american school of american cooking, just as it ' s all about high - tech [SEP]", "detok_text": "[CLS] public freedom. \" [SEP] private sales opened last week at $12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that's what is an american school of american cooking, just as it's all about high - tech [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i ' m a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP]", "detok_text": "[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i'm a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring our soldiers into action, \" said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said : \" he ' s an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man ' s arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP]", "detok_text": "[CLS] be able to bring our soldiers into action, \"said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said:\" he's an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man's arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs : hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP]", "detok_text": "[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs: hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, the club ' s executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell ' s attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] \" we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving, \" he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP]", "detok_text": "[CLS] williams, the club's executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell's attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] \"we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving,\" he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] by 10 per cent. [SEP] that ' s all even more so, in their view, as they don ' t speak to their children. [SEP] the lakers didn ' t risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder ' s two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP]", "detok_text": "[CLS] by 10 per cent. [SEP] that's all even more so, in their view, as they don't speak to their children. [SEP] the lakers didn't risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder's two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] up on his efforts to repeal the new people ' s law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant ' s main floor in the island ' s northern corner. [SEP] little rock, ark. [SEP]", "detok_text": "[CLS] up on his efforts to repeal the new people's law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant's main floor in the island's northern corner. [SEP] little rock, ark. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it ' s not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world ' s top indian film director has taken charge of the country ' s budget, dropping his [SEP]", "detok_text": "[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it's not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world's top indian film director has taken charge of the country's budget, dropping his [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it ' s always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series ; yes, he was [SEP]", "detok_text": "[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it's always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series; yes, he was [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john ' s was still buried long after his death in 2 1 / 2 years ago. [SEP] it is the final day of parliament and the prime minister ' s funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] ( ap ) - - craig johnson held up his lead and was good [SEP]", "detok_text": "[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john's was still buried long after his death in 2 1/2 years ago. [SEP] it is the final day of parliament and the prime minister's funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] (ap) - - craig johnson held up his lead and was good [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan ' s recent election, given \" today ' s announcement that the taliban [SEP]", "detok_text": "[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan's recent election, given \" today's announcement that the taliban [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company ' s investor relations website ( www. wthrewcorp. com ) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP]", "detok_text": "[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company's investor relations website (www. wthrewcorp. com) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don ' t know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $ 100m through a payment system called the public service system ( csr [SEP]", "detok_text": "[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don't know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $100m through a payment system called the public service system ( csr [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP]", "detok_text": "[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great \" education. \" [SEP] i don ' t remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company ' s board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton ' s campaign [SEP]", "detok_text": "[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great \"education.\" [SEP] i don't remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company's board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton's campaign [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] \" you ' re not able to get work, you ' re out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP]", "detok_text": "[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] \" you're not able to get work, you're out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said : \" it ' s a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP]", "detok_text": "[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said: \" it's a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai ' s brother, mr al - karzai ' s son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP]", "detok_text": "[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai's brother, mr al - karzai's son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP]", "detok_text": "[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP]", "detok_text": "[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP]", "detok_text": "[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP]", "detok_text": "[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] \" i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP]", "detok_text": "[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] \" i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] \" it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force ' s chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP] \" those who know if there is any substance to this type of information were asked to back up up, \" he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] \"it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force's chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP]\" those who know if there is any substance to this type of information were asked to back up up, \" he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $ 1. 7 billion of gold on its reserves as china, the world ' s second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP]", "detok_text": "[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $1. 7 billion of gold on its reserves as china, the world's second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] $ 80 to $ 90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country ' s parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there ' s also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin ( d - mich. ) said that it was time for barack obama to take his post as president. [SEP] he was [SEP]", "detok_text": "[CLS] $80 to $90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country's parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there's also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin (d - mich.) said that it was time for barack obama to take his post as president. [SEP] he was [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $ 100, 000 and the current bonus package worth $ 250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that \" direct complaints \" were not made and the plant ' s co - operation had to be closed. [SEP] a strasbourg court [SEP]", "detok_text": "[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $100, 000 and the current bonus package worth $250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that \"direct complaints\" were not made and the plant's co - operation had to be closed. [SEP] a strasbourg court [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] \" we have already taken the measures to ensure the spread of flu is linked to improving care, \" the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP]", "detok_text": "[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] \"we have already taken the measures to ensure the spread of flu is linked to improving care,\" the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan ' s pashtun in the south. [SEP] \" our manager ' s job to determine how it all happened to us, \" he said. [SEP] as one collector notes, \" he ' s kept going away for just about five years, \" he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP]", "detok_text": "[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan's pashtun in the south. [SEP] \"our manager's job to determine how it all happened to us,\" he said. [SEP] as one collector notes, \"he's kept going away for just about five years,\" he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin ' s 2008 vice presidential pick, launched a special inquiry into gov. palin ' s selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP]", "detok_text": "[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin's 2008 vice presidential pick, launched a special inquiry into gov. palin's selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden ' s speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey ' s \" x [SEP]", "detok_text": "[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden's speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey's \" x [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] station, is to appear in magistrates ' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] \" the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let ' s not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP]", "detok_text": "[CLS] station, is to appear in magistrates' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] \" the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let's not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i ' m more likely to have been hit more than i ever thought. [SEP] the study also found [SEP]", "detok_text": "[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i'm more likely to have been hit more than i ever thought. [SEP] the study also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it ' s like a movie she ' s made. [SEP] he also asked john mcguinner, the scottish government ' s executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday ' s fourth - quarter performance. [SEP] but if a baby dies a few [SEP]", "detok_text": "[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it's like a movie she's made. [SEP] he also asked john mcguinner, the scottish government's executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday's fourth - quarter performance. [SEP] but if a baby dies a few [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes : joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service ' s office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP]", "detok_text": "[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes: joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service's office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun ' s comments to north american scientists have long been consistent. [SEP] not so many americans [SEP]", "detok_text": "[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun's comments to north american scientists have long been consistent. [SEP] not so many americans [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] months. [SEP] in line with the national service ' s plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain ' s institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP]", "detok_text": "[CLS] months. [SEP] in line with the national service's plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain's institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house ' s roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP]", "detok_text": "[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house's roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don ' t know - - or can ' t have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, \" war on evil. \" [SEP] \" you can see i had the car down on the back to myself. [SEP] \" when [SEP]", "detok_text": "[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don't know - - or can't have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, \"war on evil.\" [SEP] \"you can see i had the car down on the back to myself. [SEP]\" when [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year ' s pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world ' s new best - in - class car [SEP]", "detok_text": "[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year's pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world's new best - in - class car [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] t get enough to be angry, \" he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants ' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase, \" long gone. \" [SEP] in a [SEP]", "detok_text": "[CLS] t get enough to be angry, \"he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase,\" long gone. \" [SEP] in a [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain ' s air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] \" despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits, \" said richard shepherd, the mpc ' s chief economist, [SEP]", "detok_text": "[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain's air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] \"despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits,\" said richard shepherd, the mpc's chief economist, [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS]. [SEP] appearing in a programme - programme on bbc ' s morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king ' s college of new church in inverness and king ' s church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP]", "detok_text": "[CLS]. [SEP] appearing in a programme - programme on bbc's morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king's college of new church in inverness and king's church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn ' t he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke ' s successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP]", "detok_text": "[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn't he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke's successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p12_top64_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p12_top64_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..024dc90c8fce29e674d36c3e9794a955e696e093 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p12_top64_detok_raw_samples.txt @@ -0,0 +1,236 @@ +const_thrs_tau0p12_top64_detok +{ + "type": "summary", + "name": "const_thrs_tau0p12_top64", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "const_thrs_tau0p12_top64", + "steps": 128, + "temp_start": 1.45, + "temp_end": 1.45, + "temp_schedule": "const", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_cosine", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.12, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 41.80839195562669, + "nll_per_token": 3.7330970838688944, + "tokens": 9725 + }, + "diversity": { + "sample_entropy": 4.204396875108297, + "unique_tokens": 1943, + "token_count": 8192, + "distinct_1": 0.2371826171875, + "distinct_2": 0.7140748031496063, + "top_token_mass": 0.0560302734375 + } +} + +===== sample 000 ===== +[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world's biggest credit - card companies and stripped out $6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] "we're very involved in policing schools, roads and buildings and we're working all over london to find incidents like this," he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon's appointment as a former u. n. [SEP] + +===== sample 001 ===== +[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence's specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP] + +===== sample 002 ===== +[CLS] wouldn't be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company's board voted overwhelmingly in support of president obama's plans in iraq for the next six months, leaving at least $200 billion over two months of war time. [SEP] no, he didn't know all the extra money. [SEP] the proposed changes would undermine the core of the state's constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP] + +===== sample 003 ===== +[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel (020 78777; www. explore. co. uk), revenue & customs holidays (020 730000) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP] + +===== sample 004 ===== +[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] "the situation is that it will be improved," he said. [SEP] "normally, ideally, people would see it later in the next month, doing it at least once a month," said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP] + +===== sample 005 ===== +[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, "and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff's department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP]" it [SEP] + +===== sample 006 ===== +[CLS] prosecutors in the mclelland case review the federal grand jury's findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government's last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can't imagine texting a baby, or [SEP] + +===== sample 007 ===== +[CLS] receive a guaranteed bonus of $4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] " i'll tell you today, he's much more effective than now. [SEP] these institutions are not entirely strangers; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP] + +===== sample 008 ===== +[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc (goo. o), microsoft corp (ms. n), google inc ( gooft. o, microsoft inc's top customer, and electric co inc (ge. nx: quote, profile, research, stock buzz) have announced plans to put net sales of $3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP] + +===== sample 009 ===== +[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister's home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually "on track" for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP] + +===== sample 010 ===== +[CLS] air, was deputy leader in russia's mi - 1 programme, and built russia's mirov ballistic missiles in addition to russia's first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama's 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP] + +===== sample 011 ===== +[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush's failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP] + +===== sample 012 ===== +[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won't be for long until you get water. [SEP] " the difference between being a husband and being a mother now is clear. [SEP] but what [SEP] + +===== sample 013 ===== +[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said: "this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department's report will not have historical significance and that" if law [SEP] + +===== sample 014 ===== +[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich's attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] " when a e - mail or email address is sent to someone at birth, which i don't know [SEP] + +===== sample 015 ===== +[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university's college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] "they want to... [SEP] he says that he" has a lot of great points, "but that he knows it is" very good " and does not believe this. [SEP] for all this time, it was in iceland's interest of nationalising its financial sector, and, of course, [SEP] + +===== sample 016 ===== +[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club's executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company's board, has made a $3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] " there is no sense [SEP] + +===== sample 017 ===== +[CLS] alaska's polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel's education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] " it's an early day [SEP] + +===== sample 018 ===== +[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP] + +===== sample 019 ===== +[CLS] rise of new zealand's fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he'd scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan's authorities are saying [SEP] + +===== sample 020 ===== +[CLS] public freedom. " [SEP] private sales opened last week at $12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that's what is an american school of american cooking, just as it's all about high - tech [SEP] + +===== sample 021 ===== +[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i'm a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP] + +===== sample 022 ===== +[CLS] be able to bring our soldiers into action, "said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said:" he's an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man's arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP] + +===== sample 023 ===== +[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs: hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP] + +===== sample 024 ===== +[CLS] williams, the club's executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell's attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] "we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving," he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP] + +===== sample 025 ===== +[CLS] by 10 per cent. [SEP] that's all even more so, in their view, as they don't speak to their children. [SEP] the lakers didn't risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder's two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP] + +===== sample 026 ===== +[CLS] up on his efforts to repeal the new people's law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant's main floor in the island's northern corner. [SEP] little rock, ark. [SEP] + +===== sample 027 ===== +[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it's not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world's top indian film director has taken charge of the country's budget, dropping his [SEP] + +===== sample 028 ===== +[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it's always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series; yes, he was [SEP] + +===== sample 029 ===== +[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john's was still buried long after his death in 2 1/2 years ago. [SEP] it is the final day of parliament and the prime minister's funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] (ap) - - craig johnson held up his lead and was good [SEP] + +===== sample 030 ===== +[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan's recent election, given " today's announcement that the taliban [SEP] + +===== sample 031 ===== +[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company's investor relations website (www. wthrewcorp. com) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP] + +===== sample 032 ===== +[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don't know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $100m through a payment system called the public service system ( csr [SEP] + +===== sample 033 ===== +[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP] + +===== sample 034 ===== +[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great "education." [SEP] i don't remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company's board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton's campaign [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] " you're not able to get work, you're out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP] + +===== sample 036 ===== +[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said: " it's a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai's brother, mr al - karzai's son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP] + +===== sample 038 ===== +[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP] + +===== sample 039 ===== +[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP] + +===== sample 040 ===== +[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP] + +===== sample 041 ===== +[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP] + +===== sample 042 ===== +[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] " i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP] + +===== sample 043 ===== +[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] "it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force's chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP]" those who know if there is any substance to this type of information were asked to back up up, " he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $1. 7 billion of gold on its reserves as china, the world's second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP] + +===== sample 045 ===== +[CLS] $80 to $90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country's parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there's also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin (d - mich.) said that it was time for barack obama to take his post as president. [SEP] he was [SEP] + +===== sample 046 ===== +[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $100, 000 and the current bonus package worth $250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that "direct complaints" were not made and the plant's co - operation had to be closed. [SEP] a strasbourg court [SEP] + +===== sample 047 ===== +[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] "we have already taken the measures to ensure the spread of flu is linked to improving care," the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP] + +===== sample 048 ===== +[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan's pashtun in the south. [SEP] "our manager's job to determine how it all happened to us," he said. [SEP] as one collector notes, "he's kept going away for just about five years," he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP] + +===== sample 049 ===== +[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin's 2008 vice presidential pick, launched a special inquiry into gov. palin's selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP] + +===== sample 050 ===== +[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden's speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey's " x [SEP] + +===== sample 051 ===== +[CLS] station, is to appear in magistrates' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] " the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let's not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i'm more likely to have been hit more than i ever thought. [SEP] the study also found [SEP] + +===== sample 053 ===== +[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it's like a movie she's made. [SEP] he also asked john mcguinner, the scottish government's executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday's fourth - quarter performance. [SEP] but if a baby dies a few [SEP] + +===== sample 054 ===== +[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes: joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service's office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP] + +===== sample 055 ===== +[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun's comments to north american scientists have long been consistent. [SEP] not so many americans [SEP] + +===== sample 056 ===== +[CLS] months. [SEP] in line with the national service's plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain's institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP] + +===== sample 057 ===== +[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house's roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP] + +===== sample 058 ===== +[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don't know - - or can't have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, "war on evil." [SEP] "you can see i had the car down on the back to myself. [SEP]" when [SEP] + +===== sample 059 ===== +[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year's pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world's new best - in - class car [SEP] + +===== sample 060 ===== +[CLS] t get enough to be angry, "he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase," long gone. " [SEP] in a [SEP] + +===== sample 061 ===== +[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain's air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] "despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits," said richard shepherd, the mpc's chief economist, [SEP] + +===== sample 062 ===== +[CLS]. [SEP] appearing in a programme - programme on bbc's morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king's college of new church in inverness and king's church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP] + +===== sample 063 ===== +[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn't he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke's successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p12_top64_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p12_top64_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..068d760a8d245cbb88c4225a9e1fe50a573fbe1a --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p12_top64_raw_samples.txt @@ -0,0 +1,236 @@ +const_thrs_tau0p12_top64 +{ + "type": "summary", + "name": "const_thrs_tau0p12_top64", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "const_thrs_tau0p12_top64", + "steps": 128, + "temp_start": 1.45, + "temp_end": 1.45, + "temp_schedule": "const", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_cosine", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.12, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 41.80839195562669, + "nll_per_token": 3.7330970838688944, + "tokens": 9725 + }, + "diversity": { + "sample_entropy": 4.204396875108297, + "unique_tokens": 1943, + "token_count": 8192, + "distinct_1": 0.2371826171875, + "distinct_2": 0.7140748031496063, + "top_token_mass": 0.0560302734375 + } +} + +===== sample 000 ===== +[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world ' s biggest credit - card companies and stripped out $ 6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] " we ' re very involved in policing schools, roads and buildings and we ' re working all over london to find incidents like this, " he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon ' s appointment as a former u. n. [SEP] + +===== sample 001 ===== +[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence ' s specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP] + +===== sample 002 ===== +[CLS] wouldn ' t be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company ' s board voted overwhelmingly in support of president obama ' s plans in iraq for the next six months, leaving at least $ 200 billion over two months of war time. [SEP] no, he didn ' t know all the extra money. [SEP] the proposed changes would undermine the core of the state ' s constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP] + +===== sample 003 ===== +[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $ 3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel ( 020 78777 ; www. explore. co. uk ), revenue & customs holidays ( 020 730000 ) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP] + +===== sample 004 ===== +[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] " the situation is that it will be improved, " he said. [SEP] " normally, ideally, people would see it later in the next month, doing it at least once a month, " said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP] + +===== sample 005 ===== +[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, " and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff ' s department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP] " it [SEP] + +===== sample 006 ===== +[CLS] prosecutors in the mclelland case review the federal grand jury ' s findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government ' s last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can ' t imagine texting a baby, or [SEP] + +===== sample 007 ===== +[CLS] receive a guaranteed bonus of $ 4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] " i ' ll tell you today, he ' s much more effective than now. [SEP] these institutions are not entirely strangers ; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP] + +===== sample 008 ===== +[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc ( goo. o ), microsoft corp ( ms. n ), google inc ( gooft. o, microsoft inc ' s top customer, and electric co inc ( ge. nx : quote, profile, research, stock buzz ) have announced plans to put net sales of $ 3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP] + +===== sample 009 ===== +[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister ' s home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually " on track " for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP] + +===== sample 010 ===== +[CLS] air, was deputy leader in russia ' s mi - 1 programme, and built russia ' s mirov ballistic missiles in addition to russia ' s first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama ' s 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP] + +===== sample 011 ===== +[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush ' s failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP] + +===== sample 012 ===== +[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won ' t be for long until you get water. [SEP] " the difference between being a husband and being a mother now is clear. [SEP] but what [SEP] + +===== sample 013 ===== +[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said : " this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department ' s report will not have historical significance and that " if law [SEP] + +===== sample 014 ===== +[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich ' s attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] " when a e - mail or email address is sent to someone at birth, which i don ' t know [SEP] + +===== sample 015 ===== +[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university ' s college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] " they want to... [SEP] he says that he " has a lot of great points, " but that he knows it is " very good " and does not believe this. [SEP] for all this time, it was in iceland ' s interest of nationalising its financial sector, and, of course, [SEP] + +===== sample 016 ===== +[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club ' s executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company ' s board, has made a $ 3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] " there is no sense [SEP] + +===== sample 017 ===== +[CLS] alaska ' s polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel ' s education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] " it ' s an early day [SEP] + +===== sample 018 ===== +[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP] + +===== sample 019 ===== +[CLS] rise of new zealand ' s fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he ' d scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan ' s authorities are saying [SEP] + +===== sample 020 ===== +[CLS] public freedom. " [SEP] private sales opened last week at $ 12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that ' s what is an american school of american cooking, just as it ' s all about high - tech [SEP] + +===== sample 021 ===== +[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i ' m a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP] + +===== sample 022 ===== +[CLS] be able to bring our soldiers into action, " said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said : " he ' s an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man ' s arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP] + +===== sample 023 ===== +[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs : hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP] + +===== sample 024 ===== +[CLS] williams, the club ' s executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell ' s attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] " we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving, " he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP] + +===== sample 025 ===== +[CLS] by 10 per cent. [SEP] that ' s all even more so, in their view, as they don ' t speak to their children. [SEP] the lakers didn ' t risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder ' s two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP] + +===== sample 026 ===== +[CLS] up on his efforts to repeal the new people ' s law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant ' s main floor in the island ' s northern corner. [SEP] little rock, ark. [SEP] + +===== sample 027 ===== +[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it ' s not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world ' s top indian film director has taken charge of the country ' s budget, dropping his [SEP] + +===== sample 028 ===== +[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it ' s always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series ; yes, he was [SEP] + +===== sample 029 ===== +[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john ' s was still buried long after his death in 2 1 / 2 years ago. [SEP] it is the final day of parliament and the prime minister ' s funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] ( ap ) - - craig johnson held up his lead and was good [SEP] + +===== sample 030 ===== +[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan ' s recent election, given " today ' s announcement that the taliban [SEP] + +===== sample 031 ===== +[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company ' s investor relations website ( www. wthrewcorp. com ) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP] + +===== sample 032 ===== +[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don ' t know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $ 100m through a payment system called the public service system ( csr [SEP] + +===== sample 033 ===== +[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP] + +===== sample 034 ===== +[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great " education. " [SEP] i don ' t remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company ' s board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton ' s campaign [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] " you ' re not able to get work, you ' re out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP] + +===== sample 036 ===== +[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said : " it ' s a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai ' s brother, mr al - karzai ' s son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP] + +===== sample 038 ===== +[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP] + +===== sample 039 ===== +[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP] + +===== sample 040 ===== +[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP] + +===== sample 041 ===== +[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP] + +===== sample 042 ===== +[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] " i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP] + +===== sample 043 ===== +[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] " it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force ' s chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP] " those who know if there is any substance to this type of information were asked to back up up, " he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $ 1. 7 billion of gold on its reserves as china, the world ' s second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP] + +===== sample 045 ===== +[CLS] $ 80 to $ 90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country ' s parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there ' s also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin ( d - mich. ) said that it was time for barack obama to take his post as president. [SEP] he was [SEP] + +===== sample 046 ===== +[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $ 100, 000 and the current bonus package worth $ 250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that " direct complaints " were not made and the plant ' s co - operation had to be closed. [SEP] a strasbourg court [SEP] + +===== sample 047 ===== +[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] " we have already taken the measures to ensure the spread of flu is linked to improving care, " the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP] + +===== sample 048 ===== +[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan ' s pashtun in the south. [SEP] " our manager ' s job to determine how it all happened to us, " he said. [SEP] as one collector notes, " he ' s kept going away for just about five years, " he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP] + +===== sample 049 ===== +[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin ' s 2008 vice presidential pick, launched a special inquiry into gov. palin ' s selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP] + +===== sample 050 ===== +[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden ' s speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey ' s " x [SEP] + +===== sample 051 ===== +[CLS] station, is to appear in magistrates ' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] " the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let ' s not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i ' m more likely to have been hit more than i ever thought. [SEP] the study also found [SEP] + +===== sample 053 ===== +[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it ' s like a movie she ' s made. [SEP] he also asked john mcguinner, the scottish government ' s executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday ' s fourth - quarter performance. [SEP] but if a baby dies a few [SEP] + +===== sample 054 ===== +[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes : joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service ' s office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP] + +===== sample 055 ===== +[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun ' s comments to north american scientists have long been consistent. [SEP] not so many americans [SEP] + +===== sample 056 ===== +[CLS] months. [SEP] in line with the national service ' s plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain ' s institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP] + +===== sample 057 ===== +[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house ' s roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP] + +===== sample 058 ===== +[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don ' t know - - or can ' t have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, " war on evil. " [SEP] " you can see i had the car down on the back to myself. [SEP] " when [SEP] + +===== sample 059 ===== +[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year ' s pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world ' s new best - in - class car [SEP] + +===== sample 060 ===== +[CLS] t get enough to be angry, " he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants ' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase, " long gone. " [SEP] in a [SEP] + +===== sample 061 ===== +[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain ' s air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] " despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits, " said richard shepherd, the mpc ' s chief economist, [SEP] + +===== sample 062 ===== +[CLS]. [SEP] appearing in a programme - programme on bbc ' s morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king ' s college of new church in inverness and king ' s church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP] + +===== sample 063 ===== +[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn ' t he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke ' s successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p12_top64_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p12_top64_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..2bc0eff769d67f18b18f2c1b4c4b551a91f71e87 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p12_top64_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "const_thrs_tau0p12_top64", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "const_thrs_tau0p12_top64", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_cosine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 64, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.12, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 41.80839195562669, "nll_per_token": 3.7330970838688944, "tokens": 9725}, "diversity": {"sample_entropy": 4.204396875108297, "unique_tokens": 1943, "token_count": 8192, "distinct_1": 0.2371826171875, "distinct_2": 0.7140748031496063, "top_token_mass": 0.0560302734375}} +{"type": "sample", "index": 0, "raw_text": "[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world ' s biggest credit - card companies and stripped out $ 6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] \" we ' re very involved in policing schools, roads and buildings and we ' re working all over london to find incidents like this, \" he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon ' s appointment as a former u. n. [SEP]", "detok_text": "[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world's biggest credit - card companies and stripped out $6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] \"we're very involved in policing schools, roads and buildings and we're working all over london to find incidents like this,\" he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon's appointment as a former u. n. [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence ' s specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP]", "detok_text": "[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence's specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] wouldn ' t be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company ' s board voted overwhelmingly in support of president obama ' s plans in iraq for the next six months, leaving at least $ 200 billion over two months of war time. [SEP] no, he didn ' t know all the extra money. [SEP] the proposed changes would undermine the core of the state ' s constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP]", "detok_text": "[CLS] wouldn't be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company's board voted overwhelmingly in support of president obama's plans in iraq for the next six months, leaving at least $200 billion over two months of war time. [SEP] no, he didn't know all the extra money. [SEP] the proposed changes would undermine the core of the state's constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $ 3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel ( 020 78777 ; www. explore. co. uk ), revenue & customs holidays ( 020 730000 ) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP]", "detok_text": "[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel (020 78777; www. explore. co. uk), revenue & customs holidays (020 730000) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] \" the situation is that it will be improved, \" he said. [SEP] \" normally, ideally, people would see it later in the next month, doing it at least once a month, \" said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP]", "detok_text": "[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] \"the situation is that it will be improved,\" he said. [SEP] \"normally, ideally, people would see it later in the next month, doing it at least once a month,\" said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, \" and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff ' s department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP] \" it [SEP]", "detok_text": "[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, \"and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff's department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP]\" it [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] prosecutors in the mclelland case review the federal grand jury ' s findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government ' s last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can ' t imagine texting a baby, or [SEP]", "detok_text": "[CLS] prosecutors in the mclelland case review the federal grand jury's findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government's last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can't imagine texting a baby, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] receive a guaranteed bonus of $ 4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] \" i ' ll tell you today, he ' s much more effective than now. [SEP] these institutions are not entirely strangers ; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP]", "detok_text": "[CLS] receive a guaranteed bonus of $4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] \" i'll tell you today, he's much more effective than now. [SEP] these institutions are not entirely strangers; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc ( goo. o ), microsoft corp ( ms. n ), google inc ( gooft. o, microsoft inc ' s top customer, and electric co inc ( ge. nx : quote, profile, research, stock buzz ) have announced plans to put net sales of $ 3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP]", "detok_text": "[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc (goo. o), microsoft corp (ms. n), google inc ( gooft. o, microsoft inc's top customer, and electric co inc (ge. nx: quote, profile, research, stock buzz) have announced plans to put net sales of $3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister ' s home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually \" on track \" for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP]", "detok_text": "[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister's home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually \"on track\" for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] air, was deputy leader in russia ' s mi - 1 programme, and built russia ' s mirov ballistic missiles in addition to russia ' s first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama ' s 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP]", "detok_text": "[CLS] air, was deputy leader in russia's mi - 1 programme, and built russia's mirov ballistic missiles in addition to russia's first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama's 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush ' s failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP]", "detok_text": "[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush's failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won ' t be for long until you get water. [SEP] \" the difference between being a husband and being a mother now is clear. [SEP] but what [SEP]", "detok_text": "[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won't be for long until you get water. [SEP] \" the difference between being a husband and being a mother now is clear. [SEP] but what [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said : \" this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department ' s report will not have historical significance and that \" if law [SEP]", "detok_text": "[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said: \"this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department's report will not have historical significance and that\" if law [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich ' s attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] \" when a e - mail or email address is sent to someone at birth, which i don ' t know [SEP]", "detok_text": "[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich's attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] \" when a e - mail or email address is sent to someone at birth, which i don't know [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university ' s college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] \" they want to... [SEP] he says that he \" has a lot of great points, \" but that he knows it is \" very good \" and does not believe this. [SEP] for all this time, it was in iceland ' s interest of nationalising its financial sector, and, of course, [SEP]", "detok_text": "[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university's college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] \"they want to... [SEP] he says that he\" has a lot of great points, \"but that he knows it is\" very good \" and does not believe this. [SEP] for all this time, it was in iceland's interest of nationalising its financial sector, and, of course, [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club ' s executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company ' s board, has made a $ 3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] \" there is no sense [SEP]", "detok_text": "[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club's executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company's board, has made a $3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] \" there is no sense [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] alaska ' s polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel ' s education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] \" it ' s an early day [SEP]", "detok_text": "[CLS] alaska's polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel's education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] \" it's an early day [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP]", "detok_text": "[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] rise of new zealand ' s fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he ' d scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan ' s authorities are saying [SEP]", "detok_text": "[CLS] rise of new zealand's fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he'd scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan's authorities are saying [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] public freedom. \" [SEP] private sales opened last week at $ 12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that ' s what is an american school of american cooking, just as it ' s all about high - tech [SEP]", "detok_text": "[CLS] public freedom. \" [SEP] private sales opened last week at $12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that's what is an american school of american cooking, just as it's all about high - tech [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i ' m a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP]", "detok_text": "[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i'm a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring our soldiers into action, \" said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said : \" he ' s an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man ' s arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP]", "detok_text": "[CLS] be able to bring our soldiers into action, \"said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said:\" he's an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man's arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs : hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP]", "detok_text": "[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs: hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, the club ' s executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell ' s attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] \" we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving, \" he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP]", "detok_text": "[CLS] williams, the club's executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell's attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] \"we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving,\" he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] by 10 per cent. [SEP] that ' s all even more so, in their view, as they don ' t speak to their children. [SEP] the lakers didn ' t risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder ' s two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP]", "detok_text": "[CLS] by 10 per cent. [SEP] that's all even more so, in their view, as they don't speak to their children. [SEP] the lakers didn't risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder's two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] up on his efforts to repeal the new people ' s law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant ' s main floor in the island ' s northern corner. [SEP] little rock, ark. [SEP]", "detok_text": "[CLS] up on his efforts to repeal the new people's law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant's main floor in the island's northern corner. [SEP] little rock, ark. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it ' s not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world ' s top indian film director has taken charge of the country ' s budget, dropping his [SEP]", "detok_text": "[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it's not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world's top indian film director has taken charge of the country's budget, dropping his [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it ' s always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series ; yes, he was [SEP]", "detok_text": "[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it's always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series; yes, he was [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john ' s was still buried long after his death in 2 1 / 2 years ago. [SEP] it is the final day of parliament and the prime minister ' s funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] ( ap ) - - craig johnson held up his lead and was good [SEP]", "detok_text": "[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john's was still buried long after his death in 2 1/2 years ago. [SEP] it is the final day of parliament and the prime minister's funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] (ap) - - craig johnson held up his lead and was good [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan ' s recent election, given \" today ' s announcement that the taliban [SEP]", "detok_text": "[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan's recent election, given \" today's announcement that the taliban [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company ' s investor relations website ( www. wthrewcorp. com ) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP]", "detok_text": "[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company's investor relations website (www. wthrewcorp. com) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don ' t know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $ 100m through a payment system called the public service system ( csr [SEP]", "detok_text": "[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don't know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $100m through a payment system called the public service system ( csr [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP]", "detok_text": "[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great \" education. \" [SEP] i don ' t remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company ' s board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton ' s campaign [SEP]", "detok_text": "[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great \"education.\" [SEP] i don't remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company's board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton's campaign [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] \" you ' re not able to get work, you ' re out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP]", "detok_text": "[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] \" you're not able to get work, you're out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said : \" it ' s a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP]", "detok_text": "[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said: \" it's a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai ' s brother, mr al - karzai ' s son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP]", "detok_text": "[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai's brother, mr al - karzai's son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP]", "detok_text": "[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP]", "detok_text": "[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP]", "detok_text": "[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP]", "detok_text": "[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] \" i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP]", "detok_text": "[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] \" i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] \" it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force ' s chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP] \" those who know if there is any substance to this type of information were asked to back up up, \" he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] \"it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force's chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP]\" those who know if there is any substance to this type of information were asked to back up up, \" he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $ 1. 7 billion of gold on its reserves as china, the world ' s second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP]", "detok_text": "[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $1. 7 billion of gold on its reserves as china, the world's second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] $ 80 to $ 90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country ' s parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there ' s also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin ( d - mich. ) said that it was time for barack obama to take his post as president. [SEP] he was [SEP]", "detok_text": "[CLS] $80 to $90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country's parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there's also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin (d - mich.) said that it was time for barack obama to take his post as president. [SEP] he was [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $ 100, 000 and the current bonus package worth $ 250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that \" direct complaints \" were not made and the plant ' s co - operation had to be closed. [SEP] a strasbourg court [SEP]", "detok_text": "[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $100, 000 and the current bonus package worth $250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that \"direct complaints\" were not made and the plant's co - operation had to be closed. [SEP] a strasbourg court [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] \" we have already taken the measures to ensure the spread of flu is linked to improving care, \" the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP]", "detok_text": "[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] \"we have already taken the measures to ensure the spread of flu is linked to improving care,\" the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan ' s pashtun in the south. [SEP] \" our manager ' s job to determine how it all happened to us, \" he said. [SEP] as one collector notes, \" he ' s kept going away for just about five years, \" he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP]", "detok_text": "[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan's pashtun in the south. [SEP] \"our manager's job to determine how it all happened to us,\" he said. [SEP] as one collector notes, \"he's kept going away for just about five years,\" he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin ' s 2008 vice presidential pick, launched a special inquiry into gov. palin ' s selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP]", "detok_text": "[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin's 2008 vice presidential pick, launched a special inquiry into gov. palin's selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden ' s speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey ' s \" x [SEP]", "detok_text": "[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden's speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey's \" x [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] station, is to appear in magistrates ' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] \" the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let ' s not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP]", "detok_text": "[CLS] station, is to appear in magistrates' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] \" the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let's not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i ' m more likely to have been hit more than i ever thought. [SEP] the study also found [SEP]", "detok_text": "[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i'm more likely to have been hit more than i ever thought. [SEP] the study also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it ' s like a movie she ' s made. [SEP] he also asked john mcguinner, the scottish government ' s executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday ' s fourth - quarter performance. [SEP] but if a baby dies a few [SEP]", "detok_text": "[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it's like a movie she's made. [SEP] he also asked john mcguinner, the scottish government's executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday's fourth - quarter performance. [SEP] but if a baby dies a few [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes : joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service ' s office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP]", "detok_text": "[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes: joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service's office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun ' s comments to north american scientists have long been consistent. [SEP] not so many americans [SEP]", "detok_text": "[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun's comments to north american scientists have long been consistent. [SEP] not so many americans [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] months. [SEP] in line with the national service ' s plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain ' s institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP]", "detok_text": "[CLS] months. [SEP] in line with the national service's plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain's institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house ' s roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP]", "detok_text": "[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house's roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don ' t know - - or can ' t have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, \" war on evil. \" [SEP] \" you can see i had the car down on the back to myself. [SEP] \" when [SEP]", "detok_text": "[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don't know - - or can't have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, \"war on evil.\" [SEP] \"you can see i had the car down on the back to myself. [SEP]\" when [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year ' s pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world ' s new best - in - class car [SEP]", "detok_text": "[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year's pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world's new best - in - class car [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] t get enough to be angry, \" he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants ' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase, \" long gone. \" [SEP] in a [SEP]", "detok_text": "[CLS] t get enough to be angry, \"he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase,\" long gone. \" [SEP] in a [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain ' s air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] \" despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits, \" said richard shepherd, the mpc ' s chief economist, [SEP]", "detok_text": "[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain's air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] \"despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits,\" said richard shepherd, the mpc's chief economist, [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS]. [SEP] appearing in a programme - programme on bbc ' s morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king ' s college of new church in inverness and king ' s church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP]", "detok_text": "[CLS]. [SEP] appearing in a programme - programme on bbc's morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king's college of new church in inverness and king's church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn ' t he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke ' s successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP]", "detok_text": "[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn't he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke's successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p2_top32_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p2_top32_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..25e01a599e11fd8244990ed9b9e72140ffc99463 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p2_top32_detok_raw_samples.txt @@ -0,0 +1,236 @@ +const_thrs_tau0p2_top32_detok +{ + "type": "summary", + "name": "const_thrs_tau0p2_top32", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "const_thrs_tau0p2_top32", + "steps": 128, + "temp_start": 1.45, + "temp_end": 1.45, + "temp_schedule": "const", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_cosine", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.2, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 41.80839195562669, + "nll_per_token": 3.7330970838688944, + "tokens": 9725 + }, + "diversity": { + "sample_entropy": 4.204396875108297, + "unique_tokens": 1943, + "token_count": 8192, + "distinct_1": 0.2371826171875, + "distinct_2": 0.7140748031496063, + "top_token_mass": 0.0560302734375 + } +} + +===== sample 000 ===== +[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world's biggest credit - card companies and stripped out $6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] "we're very involved in policing schools, roads and buildings and we're working all over london to find incidents like this," he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon's appointment as a former u. n. [SEP] + +===== sample 001 ===== +[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence's specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP] + +===== sample 002 ===== +[CLS] wouldn't be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company's board voted overwhelmingly in support of president obama's plans in iraq for the next six months, leaving at least $200 billion over two months of war time. [SEP] no, he didn't know all the extra money. [SEP] the proposed changes would undermine the core of the state's constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP] + +===== sample 003 ===== +[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel (020 78777; www. explore. co. uk), revenue & customs holidays (020 730000) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP] + +===== sample 004 ===== +[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] "the situation is that it will be improved," he said. [SEP] "normally, ideally, people would see it later in the next month, doing it at least once a month," said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP] + +===== sample 005 ===== +[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, "and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff's department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP]" it [SEP] + +===== sample 006 ===== +[CLS] prosecutors in the mclelland case review the federal grand jury's findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government's last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can't imagine texting a baby, or [SEP] + +===== sample 007 ===== +[CLS] receive a guaranteed bonus of $4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] " i'll tell you today, he's much more effective than now. [SEP] these institutions are not entirely strangers; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP] + +===== sample 008 ===== +[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc (goo. o), microsoft corp (ms. n), google inc ( gooft. o, microsoft inc's top customer, and electric co inc (ge. nx: quote, profile, research, stock buzz) have announced plans to put net sales of $3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP] + +===== sample 009 ===== +[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister's home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually "on track" for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP] + +===== sample 010 ===== +[CLS] air, was deputy leader in russia's mi - 1 programme, and built russia's mirov ballistic missiles in addition to russia's first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama's 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP] + +===== sample 011 ===== +[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush's failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP] + +===== sample 012 ===== +[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won't be for long until you get water. [SEP] " the difference between being a husband and being a mother now is clear. [SEP] but what [SEP] + +===== sample 013 ===== +[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said: "this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department's report will not have historical significance and that" if law [SEP] + +===== sample 014 ===== +[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich's attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] " when a e - mail or email address is sent to someone at birth, which i don't know [SEP] + +===== sample 015 ===== +[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university's college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] "they want to... [SEP] he says that he" has a lot of great points, "but that he knows it is" very good " and does not believe this. [SEP] for all this time, it was in iceland's interest of nationalising its financial sector, and, of course, [SEP] + +===== sample 016 ===== +[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club's executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company's board, has made a $3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] " there is no sense [SEP] + +===== sample 017 ===== +[CLS] alaska's polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel's education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] " it's an early day [SEP] + +===== sample 018 ===== +[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP] + +===== sample 019 ===== +[CLS] rise of new zealand's fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he'd scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan's authorities are saying [SEP] + +===== sample 020 ===== +[CLS] public freedom. " [SEP] private sales opened last week at $12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that's what is an american school of american cooking, just as it's all about high - tech [SEP] + +===== sample 021 ===== +[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i'm a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP] + +===== sample 022 ===== +[CLS] be able to bring our soldiers into action, "said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said:" he's an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man's arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP] + +===== sample 023 ===== +[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs: hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP] + +===== sample 024 ===== +[CLS] williams, the club's executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell's attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] "we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving," he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP] + +===== sample 025 ===== +[CLS] by 10 per cent. [SEP] that's all even more so, in their view, as they don't speak to their children. [SEP] the lakers didn't risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder's two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP] + +===== sample 026 ===== +[CLS] up on his efforts to repeal the new people's law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant's main floor in the island's northern corner. [SEP] little rock, ark. [SEP] + +===== sample 027 ===== +[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it's not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world's top indian film director has taken charge of the country's budget, dropping his [SEP] + +===== sample 028 ===== +[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it's always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series; yes, he was [SEP] + +===== sample 029 ===== +[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john's was still buried long after his death in 2 1/2 years ago. [SEP] it is the final day of parliament and the prime minister's funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] (ap) - - craig johnson held up his lead and was good [SEP] + +===== sample 030 ===== +[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan's recent election, given " today's announcement that the taliban [SEP] + +===== sample 031 ===== +[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company's investor relations website (www. wthrewcorp. com) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP] + +===== sample 032 ===== +[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don't know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $100m through a payment system called the public service system ( csr [SEP] + +===== sample 033 ===== +[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP] + +===== sample 034 ===== +[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great "education." [SEP] i don't remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company's board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton's campaign [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] " you're not able to get work, you're out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP] + +===== sample 036 ===== +[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said: " it's a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai's brother, mr al - karzai's son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP] + +===== sample 038 ===== +[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP] + +===== sample 039 ===== +[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP] + +===== sample 040 ===== +[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP] + +===== sample 041 ===== +[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP] + +===== sample 042 ===== +[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] " i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP] + +===== sample 043 ===== +[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] "it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force's chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP]" those who know if there is any substance to this type of information were asked to back up up, " he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $1. 7 billion of gold on its reserves as china, the world's second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP] + +===== sample 045 ===== +[CLS] $80 to $90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country's parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there's also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin (d - mich.) said that it was time for barack obama to take his post as president. [SEP] he was [SEP] + +===== sample 046 ===== +[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $100, 000 and the current bonus package worth $250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that "direct complaints" were not made and the plant's co - operation had to be closed. [SEP] a strasbourg court [SEP] + +===== sample 047 ===== +[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] "we have already taken the measures to ensure the spread of flu is linked to improving care," the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP] + +===== sample 048 ===== +[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan's pashtun in the south. [SEP] "our manager's job to determine how it all happened to us," he said. [SEP] as one collector notes, "he's kept going away for just about five years," he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP] + +===== sample 049 ===== +[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin's 2008 vice presidential pick, launched a special inquiry into gov. palin's selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP] + +===== sample 050 ===== +[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden's speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey's " x [SEP] + +===== sample 051 ===== +[CLS] station, is to appear in magistrates' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] " the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let's not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i'm more likely to have been hit more than i ever thought. [SEP] the study also found [SEP] + +===== sample 053 ===== +[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it's like a movie she's made. [SEP] he also asked john mcguinner, the scottish government's executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday's fourth - quarter performance. [SEP] but if a baby dies a few [SEP] + +===== sample 054 ===== +[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes: joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service's office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP] + +===== sample 055 ===== +[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun's comments to north american scientists have long been consistent. [SEP] not so many americans [SEP] + +===== sample 056 ===== +[CLS] months. [SEP] in line with the national service's plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain's institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP] + +===== sample 057 ===== +[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house's roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP] + +===== sample 058 ===== +[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don't know - - or can't have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, "war on evil." [SEP] "you can see i had the car down on the back to myself. [SEP]" when [SEP] + +===== sample 059 ===== +[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year's pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world's new best - in - class car [SEP] + +===== sample 060 ===== +[CLS] t get enough to be angry, "he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase," long gone. " [SEP] in a [SEP] + +===== sample 061 ===== +[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain's air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] "despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits," said richard shepherd, the mpc's chief economist, [SEP] + +===== sample 062 ===== +[CLS]. [SEP] appearing in a programme - programme on bbc's morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king's college of new church in inverness and king's church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP] + +===== sample 063 ===== +[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn't he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke's successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p2_top32_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p2_top32_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..1fdf8b490d92f66795f60310334cd94844056ff0 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p2_top32_raw_samples.txt @@ -0,0 +1,236 @@ +const_thrs_tau0p2_top32 +{ + "type": "summary", + "name": "const_thrs_tau0p2_top32", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "const_thrs_tau0p2_top32", + "steps": 128, + "temp_start": 1.45, + "temp_end": 1.45, + "temp_schedule": "const", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_cosine", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.2, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 41.80839195562669, + "nll_per_token": 3.7330970838688944, + "tokens": 9725 + }, + "diversity": { + "sample_entropy": 4.204396875108297, + "unique_tokens": 1943, + "token_count": 8192, + "distinct_1": 0.2371826171875, + "distinct_2": 0.7140748031496063, + "top_token_mass": 0.0560302734375 + } +} + +===== sample 000 ===== +[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world ' s biggest credit - card companies and stripped out $ 6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] " we ' re very involved in policing schools, roads and buildings and we ' re working all over london to find incidents like this, " he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon ' s appointment as a former u. n. [SEP] + +===== sample 001 ===== +[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence ' s specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP] + +===== sample 002 ===== +[CLS] wouldn ' t be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company ' s board voted overwhelmingly in support of president obama ' s plans in iraq for the next six months, leaving at least $ 200 billion over two months of war time. [SEP] no, he didn ' t know all the extra money. [SEP] the proposed changes would undermine the core of the state ' s constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP] + +===== sample 003 ===== +[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $ 3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel ( 020 78777 ; www. explore. co. uk ), revenue & customs holidays ( 020 730000 ) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP] + +===== sample 004 ===== +[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] " the situation is that it will be improved, " he said. [SEP] " normally, ideally, people would see it later in the next month, doing it at least once a month, " said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP] + +===== sample 005 ===== +[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, " and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff ' s department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP] " it [SEP] + +===== sample 006 ===== +[CLS] prosecutors in the mclelland case review the federal grand jury ' s findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government ' s last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can ' t imagine texting a baby, or [SEP] + +===== sample 007 ===== +[CLS] receive a guaranteed bonus of $ 4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] " i ' ll tell you today, he ' s much more effective than now. [SEP] these institutions are not entirely strangers ; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP] + +===== sample 008 ===== +[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc ( goo. o ), microsoft corp ( ms. n ), google inc ( gooft. o, microsoft inc ' s top customer, and electric co inc ( ge. nx : quote, profile, research, stock buzz ) have announced plans to put net sales of $ 3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP] + +===== sample 009 ===== +[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister ' s home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually " on track " for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP] + +===== sample 010 ===== +[CLS] air, was deputy leader in russia ' s mi - 1 programme, and built russia ' s mirov ballistic missiles in addition to russia ' s first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama ' s 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP] + +===== sample 011 ===== +[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush ' s failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP] + +===== sample 012 ===== +[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won ' t be for long until you get water. [SEP] " the difference between being a husband and being a mother now is clear. [SEP] but what [SEP] + +===== sample 013 ===== +[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said : " this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department ' s report will not have historical significance and that " if law [SEP] + +===== sample 014 ===== +[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich ' s attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] " when a e - mail or email address is sent to someone at birth, which i don ' t know [SEP] + +===== sample 015 ===== +[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university ' s college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] " they want to... [SEP] he says that he " has a lot of great points, " but that he knows it is " very good " and does not believe this. [SEP] for all this time, it was in iceland ' s interest of nationalising its financial sector, and, of course, [SEP] + +===== sample 016 ===== +[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club ' s executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company ' s board, has made a $ 3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] " there is no sense [SEP] + +===== sample 017 ===== +[CLS] alaska ' s polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel ' s education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] " it ' s an early day [SEP] + +===== sample 018 ===== +[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP] + +===== sample 019 ===== +[CLS] rise of new zealand ' s fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he ' d scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan ' s authorities are saying [SEP] + +===== sample 020 ===== +[CLS] public freedom. " [SEP] private sales opened last week at $ 12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that ' s what is an american school of american cooking, just as it ' s all about high - tech [SEP] + +===== sample 021 ===== +[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i ' m a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP] + +===== sample 022 ===== +[CLS] be able to bring our soldiers into action, " said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said : " he ' s an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man ' s arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP] + +===== sample 023 ===== +[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs : hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP] + +===== sample 024 ===== +[CLS] williams, the club ' s executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell ' s attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] " we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving, " he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP] + +===== sample 025 ===== +[CLS] by 10 per cent. [SEP] that ' s all even more so, in their view, as they don ' t speak to their children. [SEP] the lakers didn ' t risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder ' s two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP] + +===== sample 026 ===== +[CLS] up on his efforts to repeal the new people ' s law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant ' s main floor in the island ' s northern corner. [SEP] little rock, ark. [SEP] + +===== sample 027 ===== +[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it ' s not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world ' s top indian film director has taken charge of the country ' s budget, dropping his [SEP] + +===== sample 028 ===== +[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it ' s always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series ; yes, he was [SEP] + +===== sample 029 ===== +[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john ' s was still buried long after his death in 2 1 / 2 years ago. [SEP] it is the final day of parliament and the prime minister ' s funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] ( ap ) - - craig johnson held up his lead and was good [SEP] + +===== sample 030 ===== +[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan ' s recent election, given " today ' s announcement that the taliban [SEP] + +===== sample 031 ===== +[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company ' s investor relations website ( www. wthrewcorp. com ) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP] + +===== sample 032 ===== +[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don ' t know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $ 100m through a payment system called the public service system ( csr [SEP] + +===== sample 033 ===== +[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP] + +===== sample 034 ===== +[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great " education. " [SEP] i don ' t remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company ' s board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton ' s campaign [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] " you ' re not able to get work, you ' re out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP] + +===== sample 036 ===== +[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said : " it ' s a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai ' s brother, mr al - karzai ' s son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP] + +===== sample 038 ===== +[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP] + +===== sample 039 ===== +[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP] + +===== sample 040 ===== +[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP] + +===== sample 041 ===== +[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP] + +===== sample 042 ===== +[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] " i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP] + +===== sample 043 ===== +[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] " it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force ' s chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP] " those who know if there is any substance to this type of information were asked to back up up, " he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $ 1. 7 billion of gold on its reserves as china, the world ' s second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP] + +===== sample 045 ===== +[CLS] $ 80 to $ 90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country ' s parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there ' s also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin ( d - mich. ) said that it was time for barack obama to take his post as president. [SEP] he was [SEP] + +===== sample 046 ===== +[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $ 100, 000 and the current bonus package worth $ 250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that " direct complaints " were not made and the plant ' s co - operation had to be closed. [SEP] a strasbourg court [SEP] + +===== sample 047 ===== +[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] " we have already taken the measures to ensure the spread of flu is linked to improving care, " the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP] + +===== sample 048 ===== +[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan ' s pashtun in the south. [SEP] " our manager ' s job to determine how it all happened to us, " he said. [SEP] as one collector notes, " he ' s kept going away for just about five years, " he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP] + +===== sample 049 ===== +[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin ' s 2008 vice presidential pick, launched a special inquiry into gov. palin ' s selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP] + +===== sample 050 ===== +[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden ' s speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey ' s " x [SEP] + +===== sample 051 ===== +[CLS] station, is to appear in magistrates ' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] " the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let ' s not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i ' m more likely to have been hit more than i ever thought. [SEP] the study also found [SEP] + +===== sample 053 ===== +[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it ' s like a movie she ' s made. [SEP] he also asked john mcguinner, the scottish government ' s executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday ' s fourth - quarter performance. [SEP] but if a baby dies a few [SEP] + +===== sample 054 ===== +[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes : joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service ' s office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP] + +===== sample 055 ===== +[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun ' s comments to north american scientists have long been consistent. [SEP] not so many americans [SEP] + +===== sample 056 ===== +[CLS] months. [SEP] in line with the national service ' s plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain ' s institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP] + +===== sample 057 ===== +[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house ' s roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP] + +===== sample 058 ===== +[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don ' t know - - or can ' t have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, " war on evil. " [SEP] " you can see i had the car down on the back to myself. [SEP] " when [SEP] + +===== sample 059 ===== +[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year ' s pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world ' s new best - in - class car [SEP] + +===== sample 060 ===== +[CLS] t get enough to be angry, " he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants ' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase, " long gone. " [SEP] in a [SEP] + +===== sample 061 ===== +[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain ' s air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] " despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits, " said richard shepherd, the mpc ' s chief economist, [SEP] + +===== sample 062 ===== +[CLS]. [SEP] appearing in a programme - programme on bbc ' s morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king ' s college of new church in inverness and king ' s church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP] + +===== sample 063 ===== +[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn ' t he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke ' s successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p2_top32_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p2_top32_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..38e3d54defad5a5562cbcddc9e17581c14c9aad1 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p2_top32_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "const_thrs_tau0p2_top32", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "const_thrs_tau0p2_top32", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_cosine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 32, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.2, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 41.80839195562669, "nll_per_token": 3.7330970838688944, "tokens": 9725}, "diversity": {"sample_entropy": 4.204396875108297, "unique_tokens": 1943, "token_count": 8192, "distinct_1": 0.2371826171875, "distinct_2": 0.7140748031496063, "top_token_mass": 0.0560302734375}} +{"type": "sample", "index": 0, "raw_text": "[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world ' s biggest credit - card companies and stripped out $ 6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] \" we ' re very involved in policing schools, roads and buildings and we ' re working all over london to find incidents like this, \" he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon ' s appointment as a former u. n. [SEP]", "detok_text": "[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world's biggest credit - card companies and stripped out $6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] \"we're very involved in policing schools, roads and buildings and we're working all over london to find incidents like this,\" he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon's appointment as a former u. n. [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence ' s specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP]", "detok_text": "[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence's specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] wouldn ' t be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company ' s board voted overwhelmingly in support of president obama ' s plans in iraq for the next six months, leaving at least $ 200 billion over two months of war time. [SEP] no, he didn ' t know all the extra money. [SEP] the proposed changes would undermine the core of the state ' s constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP]", "detok_text": "[CLS] wouldn't be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company's board voted overwhelmingly in support of president obama's plans in iraq for the next six months, leaving at least $200 billion over two months of war time. [SEP] no, he didn't know all the extra money. [SEP] the proposed changes would undermine the core of the state's constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $ 3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel ( 020 78777 ; www. explore. co. uk ), revenue & customs holidays ( 020 730000 ) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP]", "detok_text": "[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel (020 78777; www. explore. co. uk), revenue & customs holidays (020 730000) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] \" the situation is that it will be improved, \" he said. [SEP] \" normally, ideally, people would see it later in the next month, doing it at least once a month, \" said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP]", "detok_text": "[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] \"the situation is that it will be improved,\" he said. [SEP] \"normally, ideally, people would see it later in the next month, doing it at least once a month,\" said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, \" and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff ' s department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP] \" it [SEP]", "detok_text": "[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, \"and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff's department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP]\" it [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] prosecutors in the mclelland case review the federal grand jury ' s findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government ' s last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can ' t imagine texting a baby, or [SEP]", "detok_text": "[CLS] prosecutors in the mclelland case review the federal grand jury's findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government's last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can't imagine texting a baby, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] receive a guaranteed bonus of $ 4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] \" i ' ll tell you today, he ' s much more effective than now. [SEP] these institutions are not entirely strangers ; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP]", "detok_text": "[CLS] receive a guaranteed bonus of $4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] \" i'll tell you today, he's much more effective than now. [SEP] these institutions are not entirely strangers; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc ( goo. o ), microsoft corp ( ms. n ), google inc ( gooft. o, microsoft inc ' s top customer, and electric co inc ( ge. nx : quote, profile, research, stock buzz ) have announced plans to put net sales of $ 3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP]", "detok_text": "[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc (goo. o), microsoft corp (ms. n), google inc ( gooft. o, microsoft inc's top customer, and electric co inc (ge. nx: quote, profile, research, stock buzz) have announced plans to put net sales of $3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister ' s home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually \" on track \" for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP]", "detok_text": "[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister's home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually \"on track\" for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] air, was deputy leader in russia ' s mi - 1 programme, and built russia ' s mirov ballistic missiles in addition to russia ' s first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama ' s 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP]", "detok_text": "[CLS] air, was deputy leader in russia's mi - 1 programme, and built russia's mirov ballistic missiles in addition to russia's first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama's 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush ' s failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP]", "detok_text": "[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush's failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won ' t be for long until you get water. [SEP] \" the difference between being a husband and being a mother now is clear. [SEP] but what [SEP]", "detok_text": "[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won't be for long until you get water. [SEP] \" the difference between being a husband and being a mother now is clear. [SEP] but what [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said : \" this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department ' s report will not have historical significance and that \" if law [SEP]", "detok_text": "[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said: \"this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department's report will not have historical significance and that\" if law [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich ' s attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] \" when a e - mail or email address is sent to someone at birth, which i don ' t know [SEP]", "detok_text": "[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich's attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] \" when a e - mail or email address is sent to someone at birth, which i don't know [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university ' s college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] \" they want to... [SEP] he says that he \" has a lot of great points, \" but that he knows it is \" very good \" and does not believe this. [SEP] for all this time, it was in iceland ' s interest of nationalising its financial sector, and, of course, [SEP]", "detok_text": "[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university's college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] \"they want to... [SEP] he says that he\" has a lot of great points, \"but that he knows it is\" very good \" and does not believe this. [SEP] for all this time, it was in iceland's interest of nationalising its financial sector, and, of course, [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club ' s executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company ' s board, has made a $ 3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] \" there is no sense [SEP]", "detok_text": "[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club's executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company's board, has made a $3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] \" there is no sense [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] alaska ' s polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel ' s education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] \" it ' s an early day [SEP]", "detok_text": "[CLS] alaska's polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel's education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] \" it's an early day [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP]", "detok_text": "[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] rise of new zealand ' s fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he ' d scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan ' s authorities are saying [SEP]", "detok_text": "[CLS] rise of new zealand's fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he'd scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan's authorities are saying [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] public freedom. \" [SEP] private sales opened last week at $ 12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that ' s what is an american school of american cooking, just as it ' s all about high - tech [SEP]", "detok_text": "[CLS] public freedom. \" [SEP] private sales opened last week at $12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that's what is an american school of american cooking, just as it's all about high - tech [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i ' m a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP]", "detok_text": "[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i'm a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring our soldiers into action, \" said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said : \" he ' s an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man ' s arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP]", "detok_text": "[CLS] be able to bring our soldiers into action, \"said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said:\" he's an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man's arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs : hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP]", "detok_text": "[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs: hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, the club ' s executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell ' s attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] \" we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving, \" he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP]", "detok_text": "[CLS] williams, the club's executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell's attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] \"we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving,\" he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] by 10 per cent. [SEP] that ' s all even more so, in their view, as they don ' t speak to their children. [SEP] the lakers didn ' t risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder ' s two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP]", "detok_text": "[CLS] by 10 per cent. [SEP] that's all even more so, in their view, as they don't speak to their children. [SEP] the lakers didn't risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder's two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] up on his efforts to repeal the new people ' s law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant ' s main floor in the island ' s northern corner. [SEP] little rock, ark. [SEP]", "detok_text": "[CLS] up on his efforts to repeal the new people's law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant's main floor in the island's northern corner. [SEP] little rock, ark. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it ' s not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world ' s top indian film director has taken charge of the country ' s budget, dropping his [SEP]", "detok_text": "[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it's not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world's top indian film director has taken charge of the country's budget, dropping his [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it ' s always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series ; yes, he was [SEP]", "detok_text": "[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it's always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series; yes, he was [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john ' s was still buried long after his death in 2 1 / 2 years ago. [SEP] it is the final day of parliament and the prime minister ' s funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] ( ap ) - - craig johnson held up his lead and was good [SEP]", "detok_text": "[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john's was still buried long after his death in 2 1/2 years ago. [SEP] it is the final day of parliament and the prime minister's funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] (ap) - - craig johnson held up his lead and was good [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan ' s recent election, given \" today ' s announcement that the taliban [SEP]", "detok_text": "[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan's recent election, given \" today's announcement that the taliban [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company ' s investor relations website ( www. wthrewcorp. com ) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP]", "detok_text": "[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company's investor relations website (www. wthrewcorp. com) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don ' t know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $ 100m through a payment system called the public service system ( csr [SEP]", "detok_text": "[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don't know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $100m through a payment system called the public service system ( csr [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP]", "detok_text": "[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great \" education. \" [SEP] i don ' t remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company ' s board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton ' s campaign [SEP]", "detok_text": "[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great \"education.\" [SEP] i don't remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company's board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton's campaign [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] \" you ' re not able to get work, you ' re out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP]", "detok_text": "[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] \" you're not able to get work, you're out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said : \" it ' s a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP]", "detok_text": "[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said: \" it's a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai ' s brother, mr al - karzai ' s son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP]", "detok_text": "[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai's brother, mr al - karzai's son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP]", "detok_text": "[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP]", "detok_text": "[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP]", "detok_text": "[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP]", "detok_text": "[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] \" i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP]", "detok_text": "[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] \" i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] \" it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force ' s chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP] \" those who know if there is any substance to this type of information were asked to back up up, \" he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] \"it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force's chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP]\" those who know if there is any substance to this type of information were asked to back up up, \" he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $ 1. 7 billion of gold on its reserves as china, the world ' s second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP]", "detok_text": "[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $1. 7 billion of gold on its reserves as china, the world's second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] $ 80 to $ 90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country ' s parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there ' s also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin ( d - mich. ) said that it was time for barack obama to take his post as president. [SEP] he was [SEP]", "detok_text": "[CLS] $80 to $90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country's parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there's also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin (d - mich.) said that it was time for barack obama to take his post as president. [SEP] he was [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $ 100, 000 and the current bonus package worth $ 250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that \" direct complaints \" were not made and the plant ' s co - operation had to be closed. [SEP] a strasbourg court [SEP]", "detok_text": "[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $100, 000 and the current bonus package worth $250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that \"direct complaints\" were not made and the plant's co - operation had to be closed. [SEP] a strasbourg court [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] \" we have already taken the measures to ensure the spread of flu is linked to improving care, \" the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP]", "detok_text": "[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] \"we have already taken the measures to ensure the spread of flu is linked to improving care,\" the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan ' s pashtun in the south. [SEP] \" our manager ' s job to determine how it all happened to us, \" he said. [SEP] as one collector notes, \" he ' s kept going away for just about five years, \" he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP]", "detok_text": "[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan's pashtun in the south. [SEP] \"our manager's job to determine how it all happened to us,\" he said. [SEP] as one collector notes, \"he's kept going away for just about five years,\" he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin ' s 2008 vice presidential pick, launched a special inquiry into gov. palin ' s selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP]", "detok_text": "[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin's 2008 vice presidential pick, launched a special inquiry into gov. palin's selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden ' s speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey ' s \" x [SEP]", "detok_text": "[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden's speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey's \" x [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] station, is to appear in magistrates ' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] \" the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let ' s not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP]", "detok_text": "[CLS] station, is to appear in magistrates' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] \" the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let's not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i ' m more likely to have been hit more than i ever thought. [SEP] the study also found [SEP]", "detok_text": "[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i'm more likely to have been hit more than i ever thought. [SEP] the study also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it ' s like a movie she ' s made. [SEP] he also asked john mcguinner, the scottish government ' s executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday ' s fourth - quarter performance. [SEP] but if a baby dies a few [SEP]", "detok_text": "[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it's like a movie she's made. [SEP] he also asked john mcguinner, the scottish government's executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday's fourth - quarter performance. [SEP] but if a baby dies a few [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes : joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service ' s office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP]", "detok_text": "[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes: joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service's office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun ' s comments to north american scientists have long been consistent. [SEP] not so many americans [SEP]", "detok_text": "[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun's comments to north american scientists have long been consistent. [SEP] not so many americans [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] months. [SEP] in line with the national service ' s plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain ' s institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP]", "detok_text": "[CLS] months. [SEP] in line with the national service's plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain's institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house ' s roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP]", "detok_text": "[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house's roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don ' t know - - or can ' t have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, \" war on evil. \" [SEP] \" you can see i had the car down on the back to myself. [SEP] \" when [SEP]", "detok_text": "[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don't know - - or can't have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, \"war on evil.\" [SEP] \"you can see i had the car down on the back to myself. [SEP]\" when [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year ' s pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world ' s new best - in - class car [SEP]", "detok_text": "[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year's pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world's new best - in - class car [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] t get enough to be angry, \" he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants ' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase, \" long gone. \" [SEP] in a [SEP]", "detok_text": "[CLS] t get enough to be angry, \"he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase,\" long gone. \" [SEP] in a [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain ' s air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] \" despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits, \" said richard shepherd, the mpc ' s chief economist, [SEP]", "detok_text": "[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain's air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] \"despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits,\" said richard shepherd, the mpc's chief economist, [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS]. [SEP] appearing in a programme - programme on bbc ' s morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king ' s college of new church in inverness and king ' s church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP]", "detok_text": "[CLS]. [SEP] appearing in a programme - programme on bbc's morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king's college of new church in inverness and king's church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn ' t he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke ' s successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP]", "detok_text": "[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn't he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke's successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p2_top64_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p2_top64_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..c108f3d2737fa845d8ce2fb69040ce02b7f82533 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p2_top64_detok_raw_samples.txt @@ -0,0 +1,236 @@ +const_thrs_tau0p2_top64_detok +{ + "type": "summary", + "name": "const_thrs_tau0p2_top64", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "const_thrs_tau0p2_top64", + "steps": 128, + "temp_start": 1.45, + "temp_end": 1.45, + "temp_schedule": "const", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_cosine", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.2, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 41.80839195562669, + "nll_per_token": 3.7330970838688944, + "tokens": 9725 + }, + "diversity": { + "sample_entropy": 4.204396875108297, + "unique_tokens": 1943, + "token_count": 8192, + "distinct_1": 0.2371826171875, + "distinct_2": 0.7140748031496063, + "top_token_mass": 0.0560302734375 + } +} + +===== sample 000 ===== +[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world's biggest credit - card companies and stripped out $6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] "we're very involved in policing schools, roads and buildings and we're working all over london to find incidents like this," he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon's appointment as a former u. n. [SEP] + +===== sample 001 ===== +[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence's specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP] + +===== sample 002 ===== +[CLS] wouldn't be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company's board voted overwhelmingly in support of president obama's plans in iraq for the next six months, leaving at least $200 billion over two months of war time. [SEP] no, he didn't know all the extra money. [SEP] the proposed changes would undermine the core of the state's constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP] + +===== sample 003 ===== +[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel (020 78777; www. explore. co. uk), revenue & customs holidays (020 730000) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP] + +===== sample 004 ===== +[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] "the situation is that it will be improved," he said. [SEP] "normally, ideally, people would see it later in the next month, doing it at least once a month," said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP] + +===== sample 005 ===== +[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, "and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff's department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP]" it [SEP] + +===== sample 006 ===== +[CLS] prosecutors in the mclelland case review the federal grand jury's findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government's last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can't imagine texting a baby, or [SEP] + +===== sample 007 ===== +[CLS] receive a guaranteed bonus of $4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] " i'll tell you today, he's much more effective than now. [SEP] these institutions are not entirely strangers; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP] + +===== sample 008 ===== +[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc (goo. o), microsoft corp (ms. n), google inc ( gooft. o, microsoft inc's top customer, and electric co inc (ge. nx: quote, profile, research, stock buzz) have announced plans to put net sales of $3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP] + +===== sample 009 ===== +[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister's home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually "on track" for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP] + +===== sample 010 ===== +[CLS] air, was deputy leader in russia's mi - 1 programme, and built russia's mirov ballistic missiles in addition to russia's first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama's 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP] + +===== sample 011 ===== +[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush's failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP] + +===== sample 012 ===== +[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won't be for long until you get water. [SEP] " the difference between being a husband and being a mother now is clear. [SEP] but what [SEP] + +===== sample 013 ===== +[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said: "this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department's report will not have historical significance and that" if law [SEP] + +===== sample 014 ===== +[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich's attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] " when a e - mail or email address is sent to someone at birth, which i don't know [SEP] + +===== sample 015 ===== +[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university's college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] "they want to... [SEP] he says that he" has a lot of great points, "but that he knows it is" very good " and does not believe this. [SEP] for all this time, it was in iceland's interest of nationalising its financial sector, and, of course, [SEP] + +===== sample 016 ===== +[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club's executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company's board, has made a $3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] " there is no sense [SEP] + +===== sample 017 ===== +[CLS] alaska's polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel's education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] " it's an early day [SEP] + +===== sample 018 ===== +[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP] + +===== sample 019 ===== +[CLS] rise of new zealand's fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he'd scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan's authorities are saying [SEP] + +===== sample 020 ===== +[CLS] public freedom. " [SEP] private sales opened last week at $12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that's what is an american school of american cooking, just as it's all about high - tech [SEP] + +===== sample 021 ===== +[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i'm a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP] + +===== sample 022 ===== +[CLS] be able to bring our soldiers into action, "said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said:" he's an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man's arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP] + +===== sample 023 ===== +[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs: hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP] + +===== sample 024 ===== +[CLS] williams, the club's executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell's attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] "we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving," he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP] + +===== sample 025 ===== +[CLS] by 10 per cent. [SEP] that's all even more so, in their view, as they don't speak to their children. [SEP] the lakers didn't risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder's two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP] + +===== sample 026 ===== +[CLS] up on his efforts to repeal the new people's law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant's main floor in the island's northern corner. [SEP] little rock, ark. [SEP] + +===== sample 027 ===== +[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it's not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world's top indian film director has taken charge of the country's budget, dropping his [SEP] + +===== sample 028 ===== +[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it's always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series; yes, he was [SEP] + +===== sample 029 ===== +[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john's was still buried long after his death in 2 1/2 years ago. [SEP] it is the final day of parliament and the prime minister's funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] (ap) - - craig johnson held up his lead and was good [SEP] + +===== sample 030 ===== +[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan's recent election, given " today's announcement that the taliban [SEP] + +===== sample 031 ===== +[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company's investor relations website (www. wthrewcorp. com) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP] + +===== sample 032 ===== +[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don't know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $100m through a payment system called the public service system ( csr [SEP] + +===== sample 033 ===== +[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP] + +===== sample 034 ===== +[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great "education." [SEP] i don't remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company's board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton's campaign [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] " you're not able to get work, you're out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP] + +===== sample 036 ===== +[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said: " it's a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai's brother, mr al - karzai's son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP] + +===== sample 038 ===== +[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP] + +===== sample 039 ===== +[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP] + +===== sample 040 ===== +[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP] + +===== sample 041 ===== +[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP] + +===== sample 042 ===== +[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] " i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP] + +===== sample 043 ===== +[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] "it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force's chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP]" those who know if there is any substance to this type of information were asked to back up up, " he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $1. 7 billion of gold on its reserves as china, the world's second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP] + +===== sample 045 ===== +[CLS] $80 to $90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country's parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there's also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin (d - mich.) said that it was time for barack obama to take his post as president. [SEP] he was [SEP] + +===== sample 046 ===== +[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $100, 000 and the current bonus package worth $250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that "direct complaints" were not made and the plant's co - operation had to be closed. [SEP] a strasbourg court [SEP] + +===== sample 047 ===== +[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] "we have already taken the measures to ensure the spread of flu is linked to improving care," the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP] + +===== sample 048 ===== +[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan's pashtun in the south. [SEP] "our manager's job to determine how it all happened to us," he said. [SEP] as one collector notes, "he's kept going away for just about five years," he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP] + +===== sample 049 ===== +[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin's 2008 vice presidential pick, launched a special inquiry into gov. palin's selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP] + +===== sample 050 ===== +[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden's speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey's " x [SEP] + +===== sample 051 ===== +[CLS] station, is to appear in magistrates' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] " the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let's not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i'm more likely to have been hit more than i ever thought. [SEP] the study also found [SEP] + +===== sample 053 ===== +[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it's like a movie she's made. [SEP] he also asked john mcguinner, the scottish government's executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday's fourth - quarter performance. [SEP] but if a baby dies a few [SEP] + +===== sample 054 ===== +[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes: joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service's office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP] + +===== sample 055 ===== +[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun's comments to north american scientists have long been consistent. [SEP] not so many americans [SEP] + +===== sample 056 ===== +[CLS] months. [SEP] in line with the national service's plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain's institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP] + +===== sample 057 ===== +[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house's roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP] + +===== sample 058 ===== +[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don't know - - or can't have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, "war on evil." [SEP] "you can see i had the car down on the back to myself. [SEP]" when [SEP] + +===== sample 059 ===== +[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year's pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world's new best - in - class car [SEP] + +===== sample 060 ===== +[CLS] t get enough to be angry, "he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase," long gone. " [SEP] in a [SEP] + +===== sample 061 ===== +[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain's air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] "despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits," said richard shepherd, the mpc's chief economist, [SEP] + +===== sample 062 ===== +[CLS]. [SEP] appearing in a programme - programme on bbc's morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king's college of new church in inverness and king's church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP] + +===== sample 063 ===== +[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn't he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke's successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p2_top64_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p2_top64_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..6dd2f6e1b1eab4d4fdf7605a692f3d3cc757078b --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p2_top64_raw_samples.txt @@ -0,0 +1,236 @@ +const_thrs_tau0p2_top64 +{ + "type": "summary", + "name": "const_thrs_tau0p2_top64", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "const_thrs_tau0p2_top64", + "steps": 128, + "temp_start": 1.45, + "temp_end": 1.45, + "temp_schedule": "const", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_cosine", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.2, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 41.80839195562669, + "nll_per_token": 3.7330970838688944, + "tokens": 9725 + }, + "diversity": { + "sample_entropy": 4.204396875108297, + "unique_tokens": 1943, + "token_count": 8192, + "distinct_1": 0.2371826171875, + "distinct_2": 0.7140748031496063, + "top_token_mass": 0.0560302734375 + } +} + +===== sample 000 ===== +[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world ' s biggest credit - card companies and stripped out $ 6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] " we ' re very involved in policing schools, roads and buildings and we ' re working all over london to find incidents like this, " he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon ' s appointment as a former u. n. [SEP] + +===== sample 001 ===== +[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence ' s specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP] + +===== sample 002 ===== +[CLS] wouldn ' t be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company ' s board voted overwhelmingly in support of president obama ' s plans in iraq for the next six months, leaving at least $ 200 billion over two months of war time. [SEP] no, he didn ' t know all the extra money. [SEP] the proposed changes would undermine the core of the state ' s constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP] + +===== sample 003 ===== +[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $ 3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel ( 020 78777 ; www. explore. co. uk ), revenue & customs holidays ( 020 730000 ) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP] + +===== sample 004 ===== +[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] " the situation is that it will be improved, " he said. [SEP] " normally, ideally, people would see it later in the next month, doing it at least once a month, " said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP] + +===== sample 005 ===== +[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, " and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff ' s department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP] " it [SEP] + +===== sample 006 ===== +[CLS] prosecutors in the mclelland case review the federal grand jury ' s findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government ' s last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can ' t imagine texting a baby, or [SEP] + +===== sample 007 ===== +[CLS] receive a guaranteed bonus of $ 4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] " i ' ll tell you today, he ' s much more effective than now. [SEP] these institutions are not entirely strangers ; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP] + +===== sample 008 ===== +[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc ( goo. o ), microsoft corp ( ms. n ), google inc ( gooft. o, microsoft inc ' s top customer, and electric co inc ( ge. nx : quote, profile, research, stock buzz ) have announced plans to put net sales of $ 3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP] + +===== sample 009 ===== +[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister ' s home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually " on track " for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP] + +===== sample 010 ===== +[CLS] air, was deputy leader in russia ' s mi - 1 programme, and built russia ' s mirov ballistic missiles in addition to russia ' s first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama ' s 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP] + +===== sample 011 ===== +[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush ' s failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP] + +===== sample 012 ===== +[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won ' t be for long until you get water. [SEP] " the difference between being a husband and being a mother now is clear. [SEP] but what [SEP] + +===== sample 013 ===== +[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said : " this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department ' s report will not have historical significance and that " if law [SEP] + +===== sample 014 ===== +[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich ' s attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] " when a e - mail or email address is sent to someone at birth, which i don ' t know [SEP] + +===== sample 015 ===== +[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university ' s college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] " they want to... [SEP] he says that he " has a lot of great points, " but that he knows it is " very good " and does not believe this. [SEP] for all this time, it was in iceland ' s interest of nationalising its financial sector, and, of course, [SEP] + +===== sample 016 ===== +[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club ' s executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company ' s board, has made a $ 3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] " there is no sense [SEP] + +===== sample 017 ===== +[CLS] alaska ' s polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel ' s education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] " it ' s an early day [SEP] + +===== sample 018 ===== +[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP] + +===== sample 019 ===== +[CLS] rise of new zealand ' s fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he ' d scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan ' s authorities are saying [SEP] + +===== sample 020 ===== +[CLS] public freedom. " [SEP] private sales opened last week at $ 12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that ' s what is an american school of american cooking, just as it ' s all about high - tech [SEP] + +===== sample 021 ===== +[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i ' m a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP] + +===== sample 022 ===== +[CLS] be able to bring our soldiers into action, " said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said : " he ' s an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man ' s arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP] + +===== sample 023 ===== +[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs : hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP] + +===== sample 024 ===== +[CLS] williams, the club ' s executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell ' s attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] " we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving, " he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP] + +===== sample 025 ===== +[CLS] by 10 per cent. [SEP] that ' s all even more so, in their view, as they don ' t speak to their children. [SEP] the lakers didn ' t risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder ' s two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP] + +===== sample 026 ===== +[CLS] up on his efforts to repeal the new people ' s law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant ' s main floor in the island ' s northern corner. [SEP] little rock, ark. [SEP] + +===== sample 027 ===== +[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it ' s not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world ' s top indian film director has taken charge of the country ' s budget, dropping his [SEP] + +===== sample 028 ===== +[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it ' s always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series ; yes, he was [SEP] + +===== sample 029 ===== +[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john ' s was still buried long after his death in 2 1 / 2 years ago. [SEP] it is the final day of parliament and the prime minister ' s funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] ( ap ) - - craig johnson held up his lead and was good [SEP] + +===== sample 030 ===== +[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan ' s recent election, given " today ' s announcement that the taliban [SEP] + +===== sample 031 ===== +[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company ' s investor relations website ( www. wthrewcorp. com ) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP] + +===== sample 032 ===== +[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don ' t know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $ 100m through a payment system called the public service system ( csr [SEP] + +===== sample 033 ===== +[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP] + +===== sample 034 ===== +[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great " education. " [SEP] i don ' t remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company ' s board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton ' s campaign [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] " you ' re not able to get work, you ' re out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP] + +===== sample 036 ===== +[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said : " it ' s a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai ' s brother, mr al - karzai ' s son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP] + +===== sample 038 ===== +[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP] + +===== sample 039 ===== +[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP] + +===== sample 040 ===== +[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP] + +===== sample 041 ===== +[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP] + +===== sample 042 ===== +[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] " i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP] + +===== sample 043 ===== +[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] " it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force ' s chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP] " those who know if there is any substance to this type of information were asked to back up up, " he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $ 1. 7 billion of gold on its reserves as china, the world ' s second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP] + +===== sample 045 ===== +[CLS] $ 80 to $ 90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country ' s parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there ' s also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin ( d - mich. ) said that it was time for barack obama to take his post as president. [SEP] he was [SEP] + +===== sample 046 ===== +[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $ 100, 000 and the current bonus package worth $ 250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that " direct complaints " were not made and the plant ' s co - operation had to be closed. [SEP] a strasbourg court [SEP] + +===== sample 047 ===== +[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] " we have already taken the measures to ensure the spread of flu is linked to improving care, " the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP] + +===== sample 048 ===== +[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan ' s pashtun in the south. [SEP] " our manager ' s job to determine how it all happened to us, " he said. [SEP] as one collector notes, " he ' s kept going away for just about five years, " he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP] + +===== sample 049 ===== +[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin ' s 2008 vice presidential pick, launched a special inquiry into gov. palin ' s selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP] + +===== sample 050 ===== +[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden ' s speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey ' s " x [SEP] + +===== sample 051 ===== +[CLS] station, is to appear in magistrates ' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] " the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let ' s not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i ' m more likely to have been hit more than i ever thought. [SEP] the study also found [SEP] + +===== sample 053 ===== +[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it ' s like a movie she ' s made. [SEP] he also asked john mcguinner, the scottish government ' s executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday ' s fourth - quarter performance. [SEP] but if a baby dies a few [SEP] + +===== sample 054 ===== +[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes : joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service ' s office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP] + +===== sample 055 ===== +[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun ' s comments to north american scientists have long been consistent. [SEP] not so many americans [SEP] + +===== sample 056 ===== +[CLS] months. [SEP] in line with the national service ' s plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain ' s institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP] + +===== sample 057 ===== +[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house ' s roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP] + +===== sample 058 ===== +[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don ' t know - - or can ' t have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, " war on evil. " [SEP] " you can see i had the car down on the back to myself. [SEP] " when [SEP] + +===== sample 059 ===== +[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year ' s pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world ' s new best - in - class car [SEP] + +===== sample 060 ===== +[CLS] t get enough to be angry, " he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants ' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase, " long gone. " [SEP] in a [SEP] + +===== sample 061 ===== +[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain ' s air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] " despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits, " said richard shepherd, the mpc ' s chief economist, [SEP] + +===== sample 062 ===== +[CLS]. [SEP] appearing in a programme - programme on bbc ' s morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king ' s college of new church in inverness and king ' s church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP] + +===== sample 063 ===== +[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn ' t he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke ' s successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p2_top64_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p2_top64_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..8474eeb9bdc5baa0c52ab8058a8a5d2c26fd2003 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p2_top64_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "const_thrs_tau0p2_top64", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "const_thrs_tau0p2_top64", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_cosine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 64, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.2, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 41.80839195562669, "nll_per_token": 3.7330970838688944, "tokens": 9725}, "diversity": {"sample_entropy": 4.204396875108297, "unique_tokens": 1943, "token_count": 8192, "distinct_1": 0.2371826171875, "distinct_2": 0.7140748031496063, "top_token_mass": 0.0560302734375}} +{"type": "sample", "index": 0, "raw_text": "[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world ' s biggest credit - card companies and stripped out $ 6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] \" we ' re very involved in policing schools, roads and buildings and we ' re working all over london to find incidents like this, \" he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon ' s appointment as a former u. n. [SEP]", "detok_text": "[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world's biggest credit - card companies and stripped out $6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] \"we're very involved in policing schools, roads and buildings and we're working all over london to find incidents like this,\" he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon's appointment as a former u. n. [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence ' s specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP]", "detok_text": "[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence's specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] wouldn ' t be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company ' s board voted overwhelmingly in support of president obama ' s plans in iraq for the next six months, leaving at least $ 200 billion over two months of war time. [SEP] no, he didn ' t know all the extra money. [SEP] the proposed changes would undermine the core of the state ' s constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP]", "detok_text": "[CLS] wouldn't be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company's board voted overwhelmingly in support of president obama's plans in iraq for the next six months, leaving at least $200 billion over two months of war time. [SEP] no, he didn't know all the extra money. [SEP] the proposed changes would undermine the core of the state's constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $ 3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel ( 020 78777 ; www. explore. co. uk ), revenue & customs holidays ( 020 730000 ) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP]", "detok_text": "[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel (020 78777; www. explore. co. uk), revenue & customs holidays (020 730000) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] \" the situation is that it will be improved, \" he said. [SEP] \" normally, ideally, people would see it later in the next month, doing it at least once a month, \" said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP]", "detok_text": "[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] \"the situation is that it will be improved,\" he said. [SEP] \"normally, ideally, people would see it later in the next month, doing it at least once a month,\" said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, \" and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff ' s department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP] \" it [SEP]", "detok_text": "[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, \"and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff's department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP]\" it [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] prosecutors in the mclelland case review the federal grand jury ' s findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government ' s last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can ' t imagine texting a baby, or [SEP]", "detok_text": "[CLS] prosecutors in the mclelland case review the federal grand jury's findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government's last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can't imagine texting a baby, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] receive a guaranteed bonus of $ 4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] \" i ' ll tell you today, he ' s much more effective than now. [SEP] these institutions are not entirely strangers ; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP]", "detok_text": "[CLS] receive a guaranteed bonus of $4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] \" i'll tell you today, he's much more effective than now. [SEP] these institutions are not entirely strangers; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc ( goo. o ), microsoft corp ( ms. n ), google inc ( gooft. o, microsoft inc ' s top customer, and electric co inc ( ge. nx : quote, profile, research, stock buzz ) have announced plans to put net sales of $ 3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP]", "detok_text": "[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc (goo. o), microsoft corp (ms. n), google inc ( gooft. o, microsoft inc's top customer, and electric co inc (ge. nx: quote, profile, research, stock buzz) have announced plans to put net sales of $3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister ' s home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually \" on track \" for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP]", "detok_text": "[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister's home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually \"on track\" for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] air, was deputy leader in russia ' s mi - 1 programme, and built russia ' s mirov ballistic missiles in addition to russia ' s first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama ' s 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP]", "detok_text": "[CLS] air, was deputy leader in russia's mi - 1 programme, and built russia's mirov ballistic missiles in addition to russia's first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama's 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush ' s failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP]", "detok_text": "[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush's failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won ' t be for long until you get water. [SEP] \" the difference between being a husband and being a mother now is clear. [SEP] but what [SEP]", "detok_text": "[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won't be for long until you get water. [SEP] \" the difference between being a husband and being a mother now is clear. [SEP] but what [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said : \" this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department ' s report will not have historical significance and that \" if law [SEP]", "detok_text": "[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said: \"this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department's report will not have historical significance and that\" if law [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich ' s attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] \" when a e - mail or email address is sent to someone at birth, which i don ' t know [SEP]", "detok_text": "[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich's attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] \" when a e - mail or email address is sent to someone at birth, which i don't know [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university ' s college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] \" they want to... [SEP] he says that he \" has a lot of great points, \" but that he knows it is \" very good \" and does not believe this. [SEP] for all this time, it was in iceland ' s interest of nationalising its financial sector, and, of course, [SEP]", "detok_text": "[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university's college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] \"they want to... [SEP] he says that he\" has a lot of great points, \"but that he knows it is\" very good \" and does not believe this. [SEP] for all this time, it was in iceland's interest of nationalising its financial sector, and, of course, [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club ' s executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company ' s board, has made a $ 3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] \" there is no sense [SEP]", "detok_text": "[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club's executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company's board, has made a $3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] \" there is no sense [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] alaska ' s polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel ' s education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] \" it ' s an early day [SEP]", "detok_text": "[CLS] alaska's polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel's education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] \" it's an early day [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP]", "detok_text": "[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] rise of new zealand ' s fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he ' d scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan ' s authorities are saying [SEP]", "detok_text": "[CLS] rise of new zealand's fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he'd scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan's authorities are saying [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] public freedom. \" [SEP] private sales opened last week at $ 12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that ' s what is an american school of american cooking, just as it ' s all about high - tech [SEP]", "detok_text": "[CLS] public freedom. \" [SEP] private sales opened last week at $12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that's what is an american school of american cooking, just as it's all about high - tech [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i ' m a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP]", "detok_text": "[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i'm a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring our soldiers into action, \" said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said : \" he ' s an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man ' s arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP]", "detok_text": "[CLS] be able to bring our soldiers into action, \"said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said:\" he's an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man's arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs : hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP]", "detok_text": "[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs: hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, the club ' s executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell ' s attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] \" we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving, \" he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP]", "detok_text": "[CLS] williams, the club's executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell's attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] \"we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving,\" he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] by 10 per cent. [SEP] that ' s all even more so, in their view, as they don ' t speak to their children. [SEP] the lakers didn ' t risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder ' s two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP]", "detok_text": "[CLS] by 10 per cent. [SEP] that's all even more so, in their view, as they don't speak to their children. [SEP] the lakers didn't risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder's two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] up on his efforts to repeal the new people ' s law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant ' s main floor in the island ' s northern corner. [SEP] little rock, ark. [SEP]", "detok_text": "[CLS] up on his efforts to repeal the new people's law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant's main floor in the island's northern corner. [SEP] little rock, ark. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it ' s not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world ' s top indian film director has taken charge of the country ' s budget, dropping his [SEP]", "detok_text": "[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it's not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world's top indian film director has taken charge of the country's budget, dropping his [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it ' s always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series ; yes, he was [SEP]", "detok_text": "[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it's always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series; yes, he was [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john ' s was still buried long after his death in 2 1 / 2 years ago. [SEP] it is the final day of parliament and the prime minister ' s funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] ( ap ) - - craig johnson held up his lead and was good [SEP]", "detok_text": "[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john's was still buried long after his death in 2 1/2 years ago. [SEP] it is the final day of parliament and the prime minister's funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] (ap) - - craig johnson held up his lead and was good [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan ' s recent election, given \" today ' s announcement that the taliban [SEP]", "detok_text": "[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan's recent election, given \" today's announcement that the taliban [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company ' s investor relations website ( www. wthrewcorp. com ) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP]", "detok_text": "[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company's investor relations website (www. wthrewcorp. com) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don ' t know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $ 100m through a payment system called the public service system ( csr [SEP]", "detok_text": "[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don't know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $100m through a payment system called the public service system ( csr [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP]", "detok_text": "[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great \" education. \" [SEP] i don ' t remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company ' s board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton ' s campaign [SEP]", "detok_text": "[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great \"education.\" [SEP] i don't remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company's board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton's campaign [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] \" you ' re not able to get work, you ' re out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP]", "detok_text": "[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] \" you're not able to get work, you're out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said : \" it ' s a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP]", "detok_text": "[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said: \" it's a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai ' s brother, mr al - karzai ' s son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP]", "detok_text": "[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai's brother, mr al - karzai's son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP]", "detok_text": "[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP]", "detok_text": "[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP]", "detok_text": "[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP]", "detok_text": "[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] \" i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP]", "detok_text": "[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] \" i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] \" it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force ' s chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP] \" those who know if there is any substance to this type of information were asked to back up up, \" he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] \"it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force's chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP]\" those who know if there is any substance to this type of information were asked to back up up, \" he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $ 1. 7 billion of gold on its reserves as china, the world ' s second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP]", "detok_text": "[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $1. 7 billion of gold on its reserves as china, the world's second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] $ 80 to $ 90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country ' s parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there ' s also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin ( d - mich. ) said that it was time for barack obama to take his post as president. [SEP] he was [SEP]", "detok_text": "[CLS] $80 to $90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country's parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there's also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin (d - mich.) said that it was time for barack obama to take his post as president. [SEP] he was [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $ 100, 000 and the current bonus package worth $ 250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that \" direct complaints \" were not made and the plant ' s co - operation had to be closed. [SEP] a strasbourg court [SEP]", "detok_text": "[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $100, 000 and the current bonus package worth $250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that \"direct complaints\" were not made and the plant's co - operation had to be closed. [SEP] a strasbourg court [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] \" we have already taken the measures to ensure the spread of flu is linked to improving care, \" the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP]", "detok_text": "[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] \"we have already taken the measures to ensure the spread of flu is linked to improving care,\" the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan ' s pashtun in the south. [SEP] \" our manager ' s job to determine how it all happened to us, \" he said. [SEP] as one collector notes, \" he ' s kept going away for just about five years, \" he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP]", "detok_text": "[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan's pashtun in the south. [SEP] \"our manager's job to determine how it all happened to us,\" he said. [SEP] as one collector notes, \"he's kept going away for just about five years,\" he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin ' s 2008 vice presidential pick, launched a special inquiry into gov. palin ' s selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP]", "detok_text": "[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin's 2008 vice presidential pick, launched a special inquiry into gov. palin's selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden ' s speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey ' s \" x [SEP]", "detok_text": "[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden's speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey's \" x [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] station, is to appear in magistrates ' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] \" the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let ' s not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP]", "detok_text": "[CLS] station, is to appear in magistrates' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] \" the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let's not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i ' m more likely to have been hit more than i ever thought. [SEP] the study also found [SEP]", "detok_text": "[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i'm more likely to have been hit more than i ever thought. [SEP] the study also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it ' s like a movie she ' s made. [SEP] he also asked john mcguinner, the scottish government ' s executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday ' s fourth - quarter performance. [SEP] but if a baby dies a few [SEP]", "detok_text": "[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it's like a movie she's made. [SEP] he also asked john mcguinner, the scottish government's executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday's fourth - quarter performance. [SEP] but if a baby dies a few [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes : joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service ' s office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP]", "detok_text": "[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes: joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service's office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun ' s comments to north american scientists have long been consistent. [SEP] not so many americans [SEP]", "detok_text": "[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun's comments to north american scientists have long been consistent. [SEP] not so many americans [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] months. [SEP] in line with the national service ' s plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain ' s institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP]", "detok_text": "[CLS] months. [SEP] in line with the national service's plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain's institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house ' s roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP]", "detok_text": "[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house's roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don ' t know - - or can ' t have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, \" war on evil. \" [SEP] \" you can see i had the car down on the back to myself. [SEP] \" when [SEP]", "detok_text": "[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don't know - - or can't have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, \"war on evil.\" [SEP] \"you can see i had the car down on the back to myself. [SEP]\" when [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year ' s pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world ' s new best - in - class car [SEP]", "detok_text": "[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year's pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world's new best - in - class car [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] t get enough to be angry, \" he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants ' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase, \" long gone. \" [SEP] in a [SEP]", "detok_text": "[CLS] t get enough to be angry, \"he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase,\" long gone. \" [SEP] in a [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain ' s air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] \" despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits, \" said richard shepherd, the mpc ' s chief economist, [SEP]", "detok_text": "[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain's air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] \"despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits,\" said richard shepherd, the mpc's chief economist, [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS]. [SEP] appearing in a programme - programme on bbc ' s morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king ' s college of new church in inverness and king ' s church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP]", "detok_text": "[CLS]. [SEP] appearing in a programme - programme on bbc's morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king's college of new church in inverness and king's church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn ' t he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke ' s successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP]", "detok_text": "[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn't he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke's successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p36_top32_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p36_top32_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..6958ac3874931d77ad30352771b96ee169c73dd6 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p36_top32_detok_raw_samples.txt @@ -0,0 +1,236 @@ +const_thrs_tau0p36_top32_detok +{ + "type": "summary", + "name": "const_thrs_tau0p36_top32", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "const_thrs_tau0p36_top32", + "steps": 128, + "temp_start": 1.45, + "temp_end": 1.45, + "temp_schedule": "const", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_cosine", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.36, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 41.80839195562669, + "nll_per_token": 3.7330970838688944, + "tokens": 9725 + }, + "diversity": { + "sample_entropy": 4.204396875108297, + "unique_tokens": 1943, + "token_count": 8192, + "distinct_1": 0.2371826171875, + "distinct_2": 0.7140748031496063, + "top_token_mass": 0.0560302734375 + } +} + +===== sample 000 ===== +[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world's biggest credit - card companies and stripped out $6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] "we're very involved in policing schools, roads and buildings and we're working all over london to find incidents like this," he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon's appointment as a former u. n. [SEP] + +===== sample 001 ===== +[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence's specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP] + +===== sample 002 ===== +[CLS] wouldn't be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company's board voted overwhelmingly in support of president obama's plans in iraq for the next six months, leaving at least $200 billion over two months of war time. [SEP] no, he didn't know all the extra money. [SEP] the proposed changes would undermine the core of the state's constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP] + +===== sample 003 ===== +[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel (020 78777; www. explore. co. uk), revenue & customs holidays (020 730000) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP] + +===== sample 004 ===== +[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] "the situation is that it will be improved," he said. [SEP] "normally, ideally, people would see it later in the next month, doing it at least once a month," said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP] + +===== sample 005 ===== +[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, "and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff's department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP]" it [SEP] + +===== sample 006 ===== +[CLS] prosecutors in the mclelland case review the federal grand jury's findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government's last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can't imagine texting a baby, or [SEP] + +===== sample 007 ===== +[CLS] receive a guaranteed bonus of $4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] " i'll tell you today, he's much more effective than now. [SEP] these institutions are not entirely strangers; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP] + +===== sample 008 ===== +[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc (goo. o), microsoft corp (ms. n), google inc ( gooft. o, microsoft inc's top customer, and electric co inc (ge. nx: quote, profile, research, stock buzz) have announced plans to put net sales of $3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP] + +===== sample 009 ===== +[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister's home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually "on track" for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP] + +===== sample 010 ===== +[CLS] air, was deputy leader in russia's mi - 1 programme, and built russia's mirov ballistic missiles in addition to russia's first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama's 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP] + +===== sample 011 ===== +[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush's failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP] + +===== sample 012 ===== +[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won't be for long until you get water. [SEP] " the difference between being a husband and being a mother now is clear. [SEP] but what [SEP] + +===== sample 013 ===== +[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said: "this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department's report will not have historical significance and that" if law [SEP] + +===== sample 014 ===== +[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich's attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] " when a e - mail or email address is sent to someone at birth, which i don't know [SEP] + +===== sample 015 ===== +[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university's college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] "they want to... [SEP] he says that he" has a lot of great points, "but that he knows it is" very good " and does not believe this. [SEP] for all this time, it was in iceland's interest of nationalising its financial sector, and, of course, [SEP] + +===== sample 016 ===== +[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club's executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company's board, has made a $3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] " there is no sense [SEP] + +===== sample 017 ===== +[CLS] alaska's polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel's education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] " it's an early day [SEP] + +===== sample 018 ===== +[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP] + +===== sample 019 ===== +[CLS] rise of new zealand's fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he'd scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan's authorities are saying [SEP] + +===== sample 020 ===== +[CLS] public freedom. " [SEP] private sales opened last week at $12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that's what is an american school of american cooking, just as it's all about high - tech [SEP] + +===== sample 021 ===== +[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i'm a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP] + +===== sample 022 ===== +[CLS] be able to bring our soldiers into action, "said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said:" he's an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man's arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP] + +===== sample 023 ===== +[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs: hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP] + +===== sample 024 ===== +[CLS] williams, the club's executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell's attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] "we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving," he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP] + +===== sample 025 ===== +[CLS] by 10 per cent. [SEP] that's all even more so, in their view, as they don't speak to their children. [SEP] the lakers didn't risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder's two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP] + +===== sample 026 ===== +[CLS] up on his efforts to repeal the new people's law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant's main floor in the island's northern corner. [SEP] little rock, ark. [SEP] + +===== sample 027 ===== +[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it's not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world's top indian film director has taken charge of the country's budget, dropping his [SEP] + +===== sample 028 ===== +[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it's always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series; yes, he was [SEP] + +===== sample 029 ===== +[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john's was still buried long after his death in 2 1/2 years ago. [SEP] it is the final day of parliament and the prime minister's funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] (ap) - - craig johnson held up his lead and was good [SEP] + +===== sample 030 ===== +[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan's recent election, given " today's announcement that the taliban [SEP] + +===== sample 031 ===== +[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company's investor relations website (www. wthrewcorp. com) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP] + +===== sample 032 ===== +[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don't know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $100m through a payment system called the public service system ( csr [SEP] + +===== sample 033 ===== +[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP] + +===== sample 034 ===== +[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great "education." [SEP] i don't remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company's board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton's campaign [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] " you're not able to get work, you're out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP] + +===== sample 036 ===== +[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said: " it's a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai's brother, mr al - karzai's son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP] + +===== sample 038 ===== +[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP] + +===== sample 039 ===== +[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP] + +===== sample 040 ===== +[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP] + +===== sample 041 ===== +[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP] + +===== sample 042 ===== +[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] " i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP] + +===== sample 043 ===== +[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] "it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force's chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP]" those who know if there is any substance to this type of information were asked to back up up, " he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $1. 7 billion of gold on its reserves as china, the world's second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP] + +===== sample 045 ===== +[CLS] $80 to $90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country's parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there's also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin (d - mich.) said that it was time for barack obama to take his post as president. [SEP] he was [SEP] + +===== sample 046 ===== +[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $100, 000 and the current bonus package worth $250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that "direct complaints" were not made and the plant's co - operation had to be closed. [SEP] a strasbourg court [SEP] + +===== sample 047 ===== +[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] "we have already taken the measures to ensure the spread of flu is linked to improving care," the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP] + +===== sample 048 ===== +[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan's pashtun in the south. [SEP] "our manager's job to determine how it all happened to us," he said. [SEP] as one collector notes, "he's kept going away for just about five years," he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP] + +===== sample 049 ===== +[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin's 2008 vice presidential pick, launched a special inquiry into gov. palin's selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP] + +===== sample 050 ===== +[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden's speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey's " x [SEP] + +===== sample 051 ===== +[CLS] station, is to appear in magistrates' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] " the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let's not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i'm more likely to have been hit more than i ever thought. [SEP] the study also found [SEP] + +===== sample 053 ===== +[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it's like a movie she's made. [SEP] he also asked john mcguinner, the scottish government's executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday's fourth - quarter performance. [SEP] but if a baby dies a few [SEP] + +===== sample 054 ===== +[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes: joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service's office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP] + +===== sample 055 ===== +[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun's comments to north american scientists have long been consistent. [SEP] not so many americans [SEP] + +===== sample 056 ===== +[CLS] months. [SEP] in line with the national service's plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain's institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP] + +===== sample 057 ===== +[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house's roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP] + +===== sample 058 ===== +[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don't know - - or can't have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, "war on evil." [SEP] "you can see i had the car down on the back to myself. [SEP]" when [SEP] + +===== sample 059 ===== +[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year's pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world's new best - in - class car [SEP] + +===== sample 060 ===== +[CLS] t get enough to be angry, "he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase," long gone. " [SEP] in a [SEP] + +===== sample 061 ===== +[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain's air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] "despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits," said richard shepherd, the mpc's chief economist, [SEP] + +===== sample 062 ===== +[CLS]. [SEP] appearing in a programme - programme on bbc's morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king's college of new church in inverness and king's church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP] + +===== sample 063 ===== +[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn't he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke's successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p36_top32_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p36_top32_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..649ef0ebf0c32118df4025b3124b6c2b1c79aad2 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p36_top32_raw_samples.txt @@ -0,0 +1,236 @@ +const_thrs_tau0p36_top32 +{ + "type": "summary", + "name": "const_thrs_tau0p36_top32", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "const_thrs_tau0p36_top32", + "steps": 128, + "temp_start": 1.45, + "temp_end": 1.45, + "temp_schedule": "const", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_cosine", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.36, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 41.80839195562669, + "nll_per_token": 3.7330970838688944, + "tokens": 9725 + }, + "diversity": { + "sample_entropy": 4.204396875108297, + "unique_tokens": 1943, + "token_count": 8192, + "distinct_1": 0.2371826171875, + "distinct_2": 0.7140748031496063, + "top_token_mass": 0.0560302734375 + } +} + +===== sample 000 ===== +[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world ' s biggest credit - card companies and stripped out $ 6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] " we ' re very involved in policing schools, roads and buildings and we ' re working all over london to find incidents like this, " he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon ' s appointment as a former u. n. [SEP] + +===== sample 001 ===== +[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence ' s specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP] + +===== sample 002 ===== +[CLS] wouldn ' t be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company ' s board voted overwhelmingly in support of president obama ' s plans in iraq for the next six months, leaving at least $ 200 billion over two months of war time. [SEP] no, he didn ' t know all the extra money. [SEP] the proposed changes would undermine the core of the state ' s constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP] + +===== sample 003 ===== +[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $ 3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel ( 020 78777 ; www. explore. co. uk ), revenue & customs holidays ( 020 730000 ) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP] + +===== sample 004 ===== +[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] " the situation is that it will be improved, " he said. [SEP] " normally, ideally, people would see it later in the next month, doing it at least once a month, " said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP] + +===== sample 005 ===== +[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, " and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff ' s department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP] " it [SEP] + +===== sample 006 ===== +[CLS] prosecutors in the mclelland case review the federal grand jury ' s findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government ' s last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can ' t imagine texting a baby, or [SEP] + +===== sample 007 ===== +[CLS] receive a guaranteed bonus of $ 4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] " i ' ll tell you today, he ' s much more effective than now. [SEP] these institutions are not entirely strangers ; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP] + +===== sample 008 ===== +[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc ( goo. o ), microsoft corp ( ms. n ), google inc ( gooft. o, microsoft inc ' s top customer, and electric co inc ( ge. nx : quote, profile, research, stock buzz ) have announced plans to put net sales of $ 3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP] + +===== sample 009 ===== +[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister ' s home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually " on track " for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP] + +===== sample 010 ===== +[CLS] air, was deputy leader in russia ' s mi - 1 programme, and built russia ' s mirov ballistic missiles in addition to russia ' s first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama ' s 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP] + +===== sample 011 ===== +[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush ' s failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP] + +===== sample 012 ===== +[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won ' t be for long until you get water. [SEP] " the difference between being a husband and being a mother now is clear. [SEP] but what [SEP] + +===== sample 013 ===== +[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said : " this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department ' s report will not have historical significance and that " if law [SEP] + +===== sample 014 ===== +[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich ' s attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] " when a e - mail or email address is sent to someone at birth, which i don ' t know [SEP] + +===== sample 015 ===== +[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university ' s college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] " they want to... [SEP] he says that he " has a lot of great points, " but that he knows it is " very good " and does not believe this. [SEP] for all this time, it was in iceland ' s interest of nationalising its financial sector, and, of course, [SEP] + +===== sample 016 ===== +[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club ' s executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company ' s board, has made a $ 3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] " there is no sense [SEP] + +===== sample 017 ===== +[CLS] alaska ' s polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel ' s education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] " it ' s an early day [SEP] + +===== sample 018 ===== +[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP] + +===== sample 019 ===== +[CLS] rise of new zealand ' s fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he ' d scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan ' s authorities are saying [SEP] + +===== sample 020 ===== +[CLS] public freedom. " [SEP] private sales opened last week at $ 12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that ' s what is an american school of american cooking, just as it ' s all about high - tech [SEP] + +===== sample 021 ===== +[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i ' m a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP] + +===== sample 022 ===== +[CLS] be able to bring our soldiers into action, " said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said : " he ' s an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man ' s arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP] + +===== sample 023 ===== +[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs : hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP] + +===== sample 024 ===== +[CLS] williams, the club ' s executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell ' s attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] " we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving, " he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP] + +===== sample 025 ===== +[CLS] by 10 per cent. [SEP] that ' s all even more so, in their view, as they don ' t speak to their children. [SEP] the lakers didn ' t risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder ' s two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP] + +===== sample 026 ===== +[CLS] up on his efforts to repeal the new people ' s law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant ' s main floor in the island ' s northern corner. [SEP] little rock, ark. [SEP] + +===== sample 027 ===== +[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it ' s not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world ' s top indian film director has taken charge of the country ' s budget, dropping his [SEP] + +===== sample 028 ===== +[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it ' s always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series ; yes, he was [SEP] + +===== sample 029 ===== +[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john ' s was still buried long after his death in 2 1 / 2 years ago. [SEP] it is the final day of parliament and the prime minister ' s funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] ( ap ) - - craig johnson held up his lead and was good [SEP] + +===== sample 030 ===== +[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan ' s recent election, given " today ' s announcement that the taliban [SEP] + +===== sample 031 ===== +[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company ' s investor relations website ( www. wthrewcorp. com ) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP] + +===== sample 032 ===== +[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don ' t know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $ 100m through a payment system called the public service system ( csr [SEP] + +===== sample 033 ===== +[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP] + +===== sample 034 ===== +[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great " education. " [SEP] i don ' t remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company ' s board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton ' s campaign [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] " you ' re not able to get work, you ' re out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP] + +===== sample 036 ===== +[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said : " it ' s a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai ' s brother, mr al - karzai ' s son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP] + +===== sample 038 ===== +[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP] + +===== sample 039 ===== +[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP] + +===== sample 040 ===== +[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP] + +===== sample 041 ===== +[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP] + +===== sample 042 ===== +[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] " i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP] + +===== sample 043 ===== +[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] " it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force ' s chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP] " those who know if there is any substance to this type of information were asked to back up up, " he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $ 1. 7 billion of gold on its reserves as china, the world ' s second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP] + +===== sample 045 ===== +[CLS] $ 80 to $ 90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country ' s parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there ' s also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin ( d - mich. ) said that it was time for barack obama to take his post as president. [SEP] he was [SEP] + +===== sample 046 ===== +[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $ 100, 000 and the current bonus package worth $ 250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that " direct complaints " were not made and the plant ' s co - operation had to be closed. [SEP] a strasbourg court [SEP] + +===== sample 047 ===== +[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] " we have already taken the measures to ensure the spread of flu is linked to improving care, " the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP] + +===== sample 048 ===== +[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan ' s pashtun in the south. [SEP] " our manager ' s job to determine how it all happened to us, " he said. [SEP] as one collector notes, " he ' s kept going away for just about five years, " he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP] + +===== sample 049 ===== +[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin ' s 2008 vice presidential pick, launched a special inquiry into gov. palin ' s selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP] + +===== sample 050 ===== +[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden ' s speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey ' s " x [SEP] + +===== sample 051 ===== +[CLS] station, is to appear in magistrates ' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] " the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let ' s not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i ' m more likely to have been hit more than i ever thought. [SEP] the study also found [SEP] + +===== sample 053 ===== +[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it ' s like a movie she ' s made. [SEP] he also asked john mcguinner, the scottish government ' s executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday ' s fourth - quarter performance. [SEP] but if a baby dies a few [SEP] + +===== sample 054 ===== +[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes : joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service ' s office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP] + +===== sample 055 ===== +[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun ' s comments to north american scientists have long been consistent. [SEP] not so many americans [SEP] + +===== sample 056 ===== +[CLS] months. [SEP] in line with the national service ' s plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain ' s institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP] + +===== sample 057 ===== +[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house ' s roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP] + +===== sample 058 ===== +[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don ' t know - - or can ' t have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, " war on evil. " [SEP] " you can see i had the car down on the back to myself. [SEP] " when [SEP] + +===== sample 059 ===== +[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year ' s pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world ' s new best - in - class car [SEP] + +===== sample 060 ===== +[CLS] t get enough to be angry, " he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants ' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase, " long gone. " [SEP] in a [SEP] + +===== sample 061 ===== +[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain ' s air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] " despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits, " said richard shepherd, the mpc ' s chief economist, [SEP] + +===== sample 062 ===== +[CLS]. [SEP] appearing in a programme - programme on bbc ' s morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king ' s college of new church in inverness and king ' s church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP] + +===== sample 063 ===== +[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn ' t he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke ' s successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p36_top32_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p36_top32_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..a70c70a05365d1d62b9e23d7e0e089afe2f8729a --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p36_top32_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "const_thrs_tau0p36_top32", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "const_thrs_tau0p36_top32", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_cosine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 32, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.36, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 41.80839195562669, "nll_per_token": 3.7330970838688944, "tokens": 9725}, "diversity": {"sample_entropy": 4.204396875108297, "unique_tokens": 1943, "token_count": 8192, "distinct_1": 0.2371826171875, "distinct_2": 0.7140748031496063, "top_token_mass": 0.0560302734375}} +{"type": "sample", "index": 0, "raw_text": "[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world ' s biggest credit - card companies and stripped out $ 6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] \" we ' re very involved in policing schools, roads and buildings and we ' re working all over london to find incidents like this, \" he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon ' s appointment as a former u. n. [SEP]", "detok_text": "[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world's biggest credit - card companies and stripped out $6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] \"we're very involved in policing schools, roads and buildings and we're working all over london to find incidents like this,\" he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon's appointment as a former u. n. [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence ' s specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP]", "detok_text": "[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence's specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] wouldn ' t be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company ' s board voted overwhelmingly in support of president obama ' s plans in iraq for the next six months, leaving at least $ 200 billion over two months of war time. [SEP] no, he didn ' t know all the extra money. [SEP] the proposed changes would undermine the core of the state ' s constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP]", "detok_text": "[CLS] wouldn't be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company's board voted overwhelmingly in support of president obama's plans in iraq for the next six months, leaving at least $200 billion over two months of war time. [SEP] no, he didn't know all the extra money. [SEP] the proposed changes would undermine the core of the state's constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $ 3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel ( 020 78777 ; www. explore. co. uk ), revenue & customs holidays ( 020 730000 ) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP]", "detok_text": "[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel (020 78777; www. explore. co. uk), revenue & customs holidays (020 730000) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] \" the situation is that it will be improved, \" he said. [SEP] \" normally, ideally, people would see it later in the next month, doing it at least once a month, \" said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP]", "detok_text": "[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] \"the situation is that it will be improved,\" he said. [SEP] \"normally, ideally, people would see it later in the next month, doing it at least once a month,\" said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, \" and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff ' s department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP] \" it [SEP]", "detok_text": "[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, \"and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff's department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP]\" it [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] prosecutors in the mclelland case review the federal grand jury ' s findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government ' s last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can ' t imagine texting a baby, or [SEP]", "detok_text": "[CLS] prosecutors in the mclelland case review the federal grand jury's findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government's last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can't imagine texting a baby, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] receive a guaranteed bonus of $ 4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] \" i ' ll tell you today, he ' s much more effective than now. [SEP] these institutions are not entirely strangers ; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP]", "detok_text": "[CLS] receive a guaranteed bonus of $4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] \" i'll tell you today, he's much more effective than now. [SEP] these institutions are not entirely strangers; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc ( goo. o ), microsoft corp ( ms. n ), google inc ( gooft. o, microsoft inc ' s top customer, and electric co inc ( ge. nx : quote, profile, research, stock buzz ) have announced plans to put net sales of $ 3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP]", "detok_text": "[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc (goo. o), microsoft corp (ms. n), google inc ( gooft. o, microsoft inc's top customer, and electric co inc (ge. nx: quote, profile, research, stock buzz) have announced plans to put net sales of $3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister ' s home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually \" on track \" for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP]", "detok_text": "[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister's home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually \"on track\" for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] air, was deputy leader in russia ' s mi - 1 programme, and built russia ' s mirov ballistic missiles in addition to russia ' s first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama ' s 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP]", "detok_text": "[CLS] air, was deputy leader in russia's mi - 1 programme, and built russia's mirov ballistic missiles in addition to russia's first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama's 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush ' s failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP]", "detok_text": "[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush's failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won ' t be for long until you get water. [SEP] \" the difference between being a husband and being a mother now is clear. [SEP] but what [SEP]", "detok_text": "[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won't be for long until you get water. [SEP] \" the difference between being a husband and being a mother now is clear. [SEP] but what [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said : \" this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department ' s report will not have historical significance and that \" if law [SEP]", "detok_text": "[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said: \"this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department's report will not have historical significance and that\" if law [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich ' s attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] \" when a e - mail or email address is sent to someone at birth, which i don ' t know [SEP]", "detok_text": "[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich's attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] \" when a e - mail or email address is sent to someone at birth, which i don't know [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university ' s college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] \" they want to... [SEP] he says that he \" has a lot of great points, \" but that he knows it is \" very good \" and does not believe this. [SEP] for all this time, it was in iceland ' s interest of nationalising its financial sector, and, of course, [SEP]", "detok_text": "[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university's college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] \"they want to... [SEP] he says that he\" has a lot of great points, \"but that he knows it is\" very good \" and does not believe this. [SEP] for all this time, it was in iceland's interest of nationalising its financial sector, and, of course, [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club ' s executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company ' s board, has made a $ 3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] \" there is no sense [SEP]", "detok_text": "[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club's executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company's board, has made a $3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] \" there is no sense [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] alaska ' s polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel ' s education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] \" it ' s an early day [SEP]", "detok_text": "[CLS] alaska's polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel's education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] \" it's an early day [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP]", "detok_text": "[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] rise of new zealand ' s fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he ' d scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan ' s authorities are saying [SEP]", "detok_text": "[CLS] rise of new zealand's fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he'd scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan's authorities are saying [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] public freedom. \" [SEP] private sales opened last week at $ 12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that ' s what is an american school of american cooking, just as it ' s all about high - tech [SEP]", "detok_text": "[CLS] public freedom. \" [SEP] private sales opened last week at $12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that's what is an american school of american cooking, just as it's all about high - tech [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i ' m a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP]", "detok_text": "[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i'm a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring our soldiers into action, \" said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said : \" he ' s an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man ' s arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP]", "detok_text": "[CLS] be able to bring our soldiers into action, \"said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said:\" he's an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man's arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs : hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP]", "detok_text": "[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs: hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, the club ' s executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell ' s attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] \" we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving, \" he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP]", "detok_text": "[CLS] williams, the club's executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell's attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] \"we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving,\" he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] by 10 per cent. [SEP] that ' s all even more so, in their view, as they don ' t speak to their children. [SEP] the lakers didn ' t risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder ' s two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP]", "detok_text": "[CLS] by 10 per cent. [SEP] that's all even more so, in their view, as they don't speak to their children. [SEP] the lakers didn't risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder's two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] up on his efforts to repeal the new people ' s law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant ' s main floor in the island ' s northern corner. [SEP] little rock, ark. [SEP]", "detok_text": "[CLS] up on his efforts to repeal the new people's law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant's main floor in the island's northern corner. [SEP] little rock, ark. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it ' s not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world ' s top indian film director has taken charge of the country ' s budget, dropping his [SEP]", "detok_text": "[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it's not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world's top indian film director has taken charge of the country's budget, dropping his [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it ' s always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series ; yes, he was [SEP]", "detok_text": "[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it's always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series; yes, he was [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john ' s was still buried long after his death in 2 1 / 2 years ago. [SEP] it is the final day of parliament and the prime minister ' s funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] ( ap ) - - craig johnson held up his lead and was good [SEP]", "detok_text": "[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john's was still buried long after his death in 2 1/2 years ago. [SEP] it is the final day of parliament and the prime minister's funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] (ap) - - craig johnson held up his lead and was good [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan ' s recent election, given \" today ' s announcement that the taliban [SEP]", "detok_text": "[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan's recent election, given \" today's announcement that the taliban [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company ' s investor relations website ( www. wthrewcorp. com ) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP]", "detok_text": "[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company's investor relations website (www. wthrewcorp. com) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don ' t know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $ 100m through a payment system called the public service system ( csr [SEP]", "detok_text": "[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don't know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $100m through a payment system called the public service system ( csr [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP]", "detok_text": "[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great \" education. \" [SEP] i don ' t remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company ' s board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton ' s campaign [SEP]", "detok_text": "[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great \"education.\" [SEP] i don't remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company's board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton's campaign [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] \" you ' re not able to get work, you ' re out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP]", "detok_text": "[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] \" you're not able to get work, you're out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said : \" it ' s a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP]", "detok_text": "[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said: \" it's a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai ' s brother, mr al - karzai ' s son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP]", "detok_text": "[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai's brother, mr al - karzai's son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP]", "detok_text": "[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP]", "detok_text": "[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP]", "detok_text": "[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP]", "detok_text": "[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] \" i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP]", "detok_text": "[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] \" i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] \" it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force ' s chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP] \" those who know if there is any substance to this type of information were asked to back up up, \" he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] \"it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force's chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP]\" those who know if there is any substance to this type of information were asked to back up up, \" he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $ 1. 7 billion of gold on its reserves as china, the world ' s second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP]", "detok_text": "[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $1. 7 billion of gold on its reserves as china, the world's second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] $ 80 to $ 90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country ' s parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there ' s also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin ( d - mich. ) said that it was time for barack obama to take his post as president. [SEP] he was [SEP]", "detok_text": "[CLS] $80 to $90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country's parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there's also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin (d - mich.) said that it was time for barack obama to take his post as president. [SEP] he was [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $ 100, 000 and the current bonus package worth $ 250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that \" direct complaints \" were not made and the plant ' s co - operation had to be closed. [SEP] a strasbourg court [SEP]", "detok_text": "[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $100, 000 and the current bonus package worth $250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that \"direct complaints\" were not made and the plant's co - operation had to be closed. [SEP] a strasbourg court [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] \" we have already taken the measures to ensure the spread of flu is linked to improving care, \" the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP]", "detok_text": "[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] \"we have already taken the measures to ensure the spread of flu is linked to improving care,\" the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan ' s pashtun in the south. [SEP] \" our manager ' s job to determine how it all happened to us, \" he said. [SEP] as one collector notes, \" he ' s kept going away for just about five years, \" he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP]", "detok_text": "[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan's pashtun in the south. [SEP] \"our manager's job to determine how it all happened to us,\" he said. [SEP] as one collector notes, \"he's kept going away for just about five years,\" he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin ' s 2008 vice presidential pick, launched a special inquiry into gov. palin ' s selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP]", "detok_text": "[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin's 2008 vice presidential pick, launched a special inquiry into gov. palin's selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden ' s speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey ' s \" x [SEP]", "detok_text": "[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden's speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey's \" x [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] station, is to appear in magistrates ' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] \" the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let ' s not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP]", "detok_text": "[CLS] station, is to appear in magistrates' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] \" the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let's not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i ' m more likely to have been hit more than i ever thought. [SEP] the study also found [SEP]", "detok_text": "[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i'm more likely to have been hit more than i ever thought. [SEP] the study also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it ' s like a movie she ' s made. [SEP] he also asked john mcguinner, the scottish government ' s executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday ' s fourth - quarter performance. [SEP] but if a baby dies a few [SEP]", "detok_text": "[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it's like a movie she's made. [SEP] he also asked john mcguinner, the scottish government's executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday's fourth - quarter performance. [SEP] but if a baby dies a few [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes : joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service ' s office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP]", "detok_text": "[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes: joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service's office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun ' s comments to north american scientists have long been consistent. [SEP] not so many americans [SEP]", "detok_text": "[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun's comments to north american scientists have long been consistent. [SEP] not so many americans [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] months. [SEP] in line with the national service ' s plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain ' s institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP]", "detok_text": "[CLS] months. [SEP] in line with the national service's plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain's institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house ' s roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP]", "detok_text": "[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house's roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don ' t know - - or can ' t have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, \" war on evil. \" [SEP] \" you can see i had the car down on the back to myself. [SEP] \" when [SEP]", "detok_text": "[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don't know - - or can't have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, \"war on evil.\" [SEP] \"you can see i had the car down on the back to myself. [SEP]\" when [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year ' s pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world ' s new best - in - class car [SEP]", "detok_text": "[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year's pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world's new best - in - class car [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] t get enough to be angry, \" he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants ' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase, \" long gone. \" [SEP] in a [SEP]", "detok_text": "[CLS] t get enough to be angry, \"he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase,\" long gone. \" [SEP] in a [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain ' s air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] \" despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits, \" said richard shepherd, the mpc ' s chief economist, [SEP]", "detok_text": "[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain's air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] \"despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits,\" said richard shepherd, the mpc's chief economist, [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS]. [SEP] appearing in a programme - programme on bbc ' s morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king ' s college of new church in inverness and king ' s church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP]", "detok_text": "[CLS]. [SEP] appearing in a programme - programme on bbc's morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king's college of new church in inverness and king's church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn ' t he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke ' s successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP]", "detok_text": "[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn't he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke's successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p36_top64_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p36_top64_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..e4ebf1d7e01bf37c1423ac40eefe1078839ac72f --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p36_top64_detok_raw_samples.txt @@ -0,0 +1,236 @@ +const_thrs_tau0p36_top64_detok +{ + "type": "summary", + "name": "const_thrs_tau0p36_top64", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "const_thrs_tau0p36_top64", + "steps": 128, + "temp_start": 1.45, + "temp_end": 1.45, + "temp_schedule": "const", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_cosine", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.36, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 41.80839195562669, + "nll_per_token": 3.7330970838688944, + "tokens": 9725 + }, + "diversity": { + "sample_entropy": 4.204396875108297, + "unique_tokens": 1943, + "token_count": 8192, + "distinct_1": 0.2371826171875, + "distinct_2": 0.7140748031496063, + "top_token_mass": 0.0560302734375 + } +} + +===== sample 000 ===== +[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world's biggest credit - card companies and stripped out $6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] "we're very involved in policing schools, roads and buildings and we're working all over london to find incidents like this," he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon's appointment as a former u. n. [SEP] + +===== sample 001 ===== +[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence's specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP] + +===== sample 002 ===== +[CLS] wouldn't be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company's board voted overwhelmingly in support of president obama's plans in iraq for the next six months, leaving at least $200 billion over two months of war time. [SEP] no, he didn't know all the extra money. [SEP] the proposed changes would undermine the core of the state's constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP] + +===== sample 003 ===== +[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel (020 78777; www. explore. co. uk), revenue & customs holidays (020 730000) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP] + +===== sample 004 ===== +[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] "the situation is that it will be improved," he said. [SEP] "normally, ideally, people would see it later in the next month, doing it at least once a month," said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP] + +===== sample 005 ===== +[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, "and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff's department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP]" it [SEP] + +===== sample 006 ===== +[CLS] prosecutors in the mclelland case review the federal grand jury's findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government's last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can't imagine texting a baby, or [SEP] + +===== sample 007 ===== +[CLS] receive a guaranteed bonus of $4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] " i'll tell you today, he's much more effective than now. [SEP] these institutions are not entirely strangers; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP] + +===== sample 008 ===== +[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc (goo. o), microsoft corp (ms. n), google inc ( gooft. o, microsoft inc's top customer, and electric co inc (ge. nx: quote, profile, research, stock buzz) have announced plans to put net sales of $3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP] + +===== sample 009 ===== +[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister's home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually "on track" for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP] + +===== sample 010 ===== +[CLS] air, was deputy leader in russia's mi - 1 programme, and built russia's mirov ballistic missiles in addition to russia's first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama's 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP] + +===== sample 011 ===== +[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush's failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP] + +===== sample 012 ===== +[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won't be for long until you get water. [SEP] " the difference between being a husband and being a mother now is clear. [SEP] but what [SEP] + +===== sample 013 ===== +[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said: "this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department's report will not have historical significance and that" if law [SEP] + +===== sample 014 ===== +[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich's attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] " when a e - mail or email address is sent to someone at birth, which i don't know [SEP] + +===== sample 015 ===== +[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university's college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] "they want to... [SEP] he says that he" has a lot of great points, "but that he knows it is" very good " and does not believe this. [SEP] for all this time, it was in iceland's interest of nationalising its financial sector, and, of course, [SEP] + +===== sample 016 ===== +[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club's executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company's board, has made a $3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] " there is no sense [SEP] + +===== sample 017 ===== +[CLS] alaska's polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel's education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] " it's an early day [SEP] + +===== sample 018 ===== +[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP] + +===== sample 019 ===== +[CLS] rise of new zealand's fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he'd scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan's authorities are saying [SEP] + +===== sample 020 ===== +[CLS] public freedom. " [SEP] private sales opened last week at $12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that's what is an american school of american cooking, just as it's all about high - tech [SEP] + +===== sample 021 ===== +[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i'm a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP] + +===== sample 022 ===== +[CLS] be able to bring our soldiers into action, "said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said:" he's an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man's arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP] + +===== sample 023 ===== +[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs: hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP] + +===== sample 024 ===== +[CLS] williams, the club's executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell's attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] "we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving," he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP] + +===== sample 025 ===== +[CLS] by 10 per cent. [SEP] that's all even more so, in their view, as they don't speak to their children. [SEP] the lakers didn't risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder's two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP] + +===== sample 026 ===== +[CLS] up on his efforts to repeal the new people's law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant's main floor in the island's northern corner. [SEP] little rock, ark. [SEP] + +===== sample 027 ===== +[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it's not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world's top indian film director has taken charge of the country's budget, dropping his [SEP] + +===== sample 028 ===== +[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it's always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series; yes, he was [SEP] + +===== sample 029 ===== +[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john's was still buried long after his death in 2 1/2 years ago. [SEP] it is the final day of parliament and the prime minister's funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] (ap) - - craig johnson held up his lead and was good [SEP] + +===== sample 030 ===== +[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan's recent election, given " today's announcement that the taliban [SEP] + +===== sample 031 ===== +[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company's investor relations website (www. wthrewcorp. com) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP] + +===== sample 032 ===== +[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don't know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $100m through a payment system called the public service system ( csr [SEP] + +===== sample 033 ===== +[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP] + +===== sample 034 ===== +[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great "education." [SEP] i don't remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company's board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton's campaign [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] " you're not able to get work, you're out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP] + +===== sample 036 ===== +[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said: " it's a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai's brother, mr al - karzai's son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP] + +===== sample 038 ===== +[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP] + +===== sample 039 ===== +[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP] + +===== sample 040 ===== +[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP] + +===== sample 041 ===== +[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP] + +===== sample 042 ===== +[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] " i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP] + +===== sample 043 ===== +[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] "it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force's chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP]" those who know if there is any substance to this type of information were asked to back up up, " he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $1. 7 billion of gold on its reserves as china, the world's second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP] + +===== sample 045 ===== +[CLS] $80 to $90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country's parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there's also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin (d - mich.) said that it was time for barack obama to take his post as president. [SEP] he was [SEP] + +===== sample 046 ===== +[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $100, 000 and the current bonus package worth $250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that "direct complaints" were not made and the plant's co - operation had to be closed. [SEP] a strasbourg court [SEP] + +===== sample 047 ===== +[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] "we have already taken the measures to ensure the spread of flu is linked to improving care," the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP] + +===== sample 048 ===== +[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan's pashtun in the south. [SEP] "our manager's job to determine how it all happened to us," he said. [SEP] as one collector notes, "he's kept going away for just about five years," he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP] + +===== sample 049 ===== +[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin's 2008 vice presidential pick, launched a special inquiry into gov. palin's selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP] + +===== sample 050 ===== +[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden's speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey's " x [SEP] + +===== sample 051 ===== +[CLS] station, is to appear in magistrates' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] " the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let's not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i'm more likely to have been hit more than i ever thought. [SEP] the study also found [SEP] + +===== sample 053 ===== +[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it's like a movie she's made. [SEP] he also asked john mcguinner, the scottish government's executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday's fourth - quarter performance. [SEP] but if a baby dies a few [SEP] + +===== sample 054 ===== +[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes: joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service's office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP] + +===== sample 055 ===== +[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun's comments to north american scientists have long been consistent. [SEP] not so many americans [SEP] + +===== sample 056 ===== +[CLS] months. [SEP] in line with the national service's plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain's institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP] + +===== sample 057 ===== +[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house's roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP] + +===== sample 058 ===== +[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don't know - - or can't have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, "war on evil." [SEP] "you can see i had the car down on the back to myself. [SEP]" when [SEP] + +===== sample 059 ===== +[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year's pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world's new best - in - class car [SEP] + +===== sample 060 ===== +[CLS] t get enough to be angry, "he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase," long gone. " [SEP] in a [SEP] + +===== sample 061 ===== +[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain's air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] "despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits," said richard shepherd, the mpc's chief economist, [SEP] + +===== sample 062 ===== +[CLS]. [SEP] appearing in a programme - programme on bbc's morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king's college of new church in inverness and king's church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP] + +===== sample 063 ===== +[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn't he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke's successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p36_top64_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p36_top64_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..d4bff974bf4b0b3808aab16a50e85c911fa75f38 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p36_top64_raw_samples.txt @@ -0,0 +1,236 @@ +const_thrs_tau0p36_top64 +{ + "type": "summary", + "name": "const_thrs_tau0p36_top64", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "const_thrs_tau0p36_top64", + "steps": 128, + "temp_start": 1.45, + "temp_end": 1.45, + "temp_schedule": "const", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_cosine", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.36, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 41.80839195562669, + "nll_per_token": 3.7330970838688944, + "tokens": 9725 + }, + "diversity": { + "sample_entropy": 4.204396875108297, + "unique_tokens": 1943, + "token_count": 8192, + "distinct_1": 0.2371826171875, + "distinct_2": 0.7140748031496063, + "top_token_mass": 0.0560302734375 + } +} + +===== sample 000 ===== +[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world ' s biggest credit - card companies and stripped out $ 6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] " we ' re very involved in policing schools, roads and buildings and we ' re working all over london to find incidents like this, " he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon ' s appointment as a former u. n. [SEP] + +===== sample 001 ===== +[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence ' s specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP] + +===== sample 002 ===== +[CLS] wouldn ' t be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company ' s board voted overwhelmingly in support of president obama ' s plans in iraq for the next six months, leaving at least $ 200 billion over two months of war time. [SEP] no, he didn ' t know all the extra money. [SEP] the proposed changes would undermine the core of the state ' s constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP] + +===== sample 003 ===== +[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $ 3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel ( 020 78777 ; www. explore. co. uk ), revenue & customs holidays ( 020 730000 ) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP] + +===== sample 004 ===== +[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] " the situation is that it will be improved, " he said. [SEP] " normally, ideally, people would see it later in the next month, doing it at least once a month, " said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP] + +===== sample 005 ===== +[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, " and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff ' s department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP] " it [SEP] + +===== sample 006 ===== +[CLS] prosecutors in the mclelland case review the federal grand jury ' s findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government ' s last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can ' t imagine texting a baby, or [SEP] + +===== sample 007 ===== +[CLS] receive a guaranteed bonus of $ 4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] " i ' ll tell you today, he ' s much more effective than now. [SEP] these institutions are not entirely strangers ; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP] + +===== sample 008 ===== +[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc ( goo. o ), microsoft corp ( ms. n ), google inc ( gooft. o, microsoft inc ' s top customer, and electric co inc ( ge. nx : quote, profile, research, stock buzz ) have announced plans to put net sales of $ 3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP] + +===== sample 009 ===== +[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister ' s home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually " on track " for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP] + +===== sample 010 ===== +[CLS] air, was deputy leader in russia ' s mi - 1 programme, and built russia ' s mirov ballistic missiles in addition to russia ' s first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama ' s 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP] + +===== sample 011 ===== +[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush ' s failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP] + +===== sample 012 ===== +[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won ' t be for long until you get water. [SEP] " the difference between being a husband and being a mother now is clear. [SEP] but what [SEP] + +===== sample 013 ===== +[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said : " this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department ' s report will not have historical significance and that " if law [SEP] + +===== sample 014 ===== +[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich ' s attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] " when a e - mail or email address is sent to someone at birth, which i don ' t know [SEP] + +===== sample 015 ===== +[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university ' s college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] " they want to... [SEP] he says that he " has a lot of great points, " but that he knows it is " very good " and does not believe this. [SEP] for all this time, it was in iceland ' s interest of nationalising its financial sector, and, of course, [SEP] + +===== sample 016 ===== +[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club ' s executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company ' s board, has made a $ 3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] " there is no sense [SEP] + +===== sample 017 ===== +[CLS] alaska ' s polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel ' s education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] " it ' s an early day [SEP] + +===== sample 018 ===== +[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP] + +===== sample 019 ===== +[CLS] rise of new zealand ' s fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he ' d scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan ' s authorities are saying [SEP] + +===== sample 020 ===== +[CLS] public freedom. " [SEP] private sales opened last week at $ 12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that ' s what is an american school of american cooking, just as it ' s all about high - tech [SEP] + +===== sample 021 ===== +[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i ' m a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP] + +===== sample 022 ===== +[CLS] be able to bring our soldiers into action, " said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said : " he ' s an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man ' s arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP] + +===== sample 023 ===== +[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs : hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP] + +===== sample 024 ===== +[CLS] williams, the club ' s executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell ' s attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] " we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving, " he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP] + +===== sample 025 ===== +[CLS] by 10 per cent. [SEP] that ' s all even more so, in their view, as they don ' t speak to their children. [SEP] the lakers didn ' t risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder ' s two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP] + +===== sample 026 ===== +[CLS] up on his efforts to repeal the new people ' s law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant ' s main floor in the island ' s northern corner. [SEP] little rock, ark. [SEP] + +===== sample 027 ===== +[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it ' s not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world ' s top indian film director has taken charge of the country ' s budget, dropping his [SEP] + +===== sample 028 ===== +[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it ' s always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series ; yes, he was [SEP] + +===== sample 029 ===== +[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john ' s was still buried long after his death in 2 1 / 2 years ago. [SEP] it is the final day of parliament and the prime minister ' s funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] ( ap ) - - craig johnson held up his lead and was good [SEP] + +===== sample 030 ===== +[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan ' s recent election, given " today ' s announcement that the taliban [SEP] + +===== sample 031 ===== +[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company ' s investor relations website ( www. wthrewcorp. com ) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP] + +===== sample 032 ===== +[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don ' t know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $ 100m through a payment system called the public service system ( csr [SEP] + +===== sample 033 ===== +[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP] + +===== sample 034 ===== +[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great " education. " [SEP] i don ' t remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company ' s board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton ' s campaign [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] " you ' re not able to get work, you ' re out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP] + +===== sample 036 ===== +[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said : " it ' s a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai ' s brother, mr al - karzai ' s son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP] + +===== sample 038 ===== +[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP] + +===== sample 039 ===== +[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP] + +===== sample 040 ===== +[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP] + +===== sample 041 ===== +[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP] + +===== sample 042 ===== +[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] " i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP] + +===== sample 043 ===== +[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] " it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force ' s chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP] " those who know if there is any substance to this type of information were asked to back up up, " he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $ 1. 7 billion of gold on its reserves as china, the world ' s second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP] + +===== sample 045 ===== +[CLS] $ 80 to $ 90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country ' s parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there ' s also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin ( d - mich. ) said that it was time for barack obama to take his post as president. [SEP] he was [SEP] + +===== sample 046 ===== +[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $ 100, 000 and the current bonus package worth $ 250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that " direct complaints " were not made and the plant ' s co - operation had to be closed. [SEP] a strasbourg court [SEP] + +===== sample 047 ===== +[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] " we have already taken the measures to ensure the spread of flu is linked to improving care, " the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP] + +===== sample 048 ===== +[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan ' s pashtun in the south. [SEP] " our manager ' s job to determine how it all happened to us, " he said. [SEP] as one collector notes, " he ' s kept going away for just about five years, " he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP] + +===== sample 049 ===== +[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin ' s 2008 vice presidential pick, launched a special inquiry into gov. palin ' s selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP] + +===== sample 050 ===== +[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden ' s speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey ' s " x [SEP] + +===== sample 051 ===== +[CLS] station, is to appear in magistrates ' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] " the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let ' s not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i ' m more likely to have been hit more than i ever thought. [SEP] the study also found [SEP] + +===== sample 053 ===== +[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it ' s like a movie she ' s made. [SEP] he also asked john mcguinner, the scottish government ' s executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday ' s fourth - quarter performance. [SEP] but if a baby dies a few [SEP] + +===== sample 054 ===== +[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes : joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service ' s office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP] + +===== sample 055 ===== +[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun ' s comments to north american scientists have long been consistent. [SEP] not so many americans [SEP] + +===== sample 056 ===== +[CLS] months. [SEP] in line with the national service ' s plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain ' s institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP] + +===== sample 057 ===== +[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house ' s roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP] + +===== sample 058 ===== +[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don ' t know - - or can ' t have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, " war on evil. " [SEP] " you can see i had the car down on the back to myself. [SEP] " when [SEP] + +===== sample 059 ===== +[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year ' s pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world ' s new best - in - class car [SEP] + +===== sample 060 ===== +[CLS] t get enough to be angry, " he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants ' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase, " long gone. " [SEP] in a [SEP] + +===== sample 061 ===== +[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain ' s air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] " despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits, " said richard shepherd, the mpc ' s chief economist, [SEP] + +===== sample 062 ===== +[CLS]. [SEP] appearing in a programme - programme on bbc ' s morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king ' s college of new church in inverness and king ' s church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP] + +===== sample 063 ===== +[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn ' t he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke ' s successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p36_top64_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p36_top64_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..3b3d47523b410b245e0f05ab0837cb08cf1261e6 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/const_thrs_tau0p36_top64_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "const_thrs_tau0p36_top64", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "const_thrs_tau0p36_top64", "steps": 128, "temp_start": 1.45, "temp_end": 1.45, "temp_schedule": "const", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_cosine", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 64, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.36, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 41.80839195562669, "nll_per_token": 3.7330970838688944, "tokens": 9725}, "diversity": {"sample_entropy": 4.204396875108297, "unique_tokens": 1943, "token_count": 8192, "distinct_1": 0.2371826171875, "distinct_2": 0.7140748031496063, "top_token_mass": 0.0560302734375}} +{"type": "sample", "index": 0, "raw_text": "[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world ' s biggest credit - card companies and stripped out $ 6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] \" we ' re very involved in policing schools, roads and buildings and we ' re working all over london to find incidents like this, \" he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon ' s appointment as a former u. n. [SEP]", "detok_text": "[CLS] the president will have to win in the next election. [SEP] it also announced bad results at some of the world's biggest credit - card companies and stripped out $6. 7 billion in the fourth quarter. [SEP] it can be due to the increased labour requirements and the change in demand, it says. [SEP] \"we're very involved in policing schools, roads and buildings and we're working all over london to find incidents like this,\" he said. [SEP] i had a good record and i was doing his best. [SEP] washington - - attorney general michael ki. moon's appointment as a former u. n. [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence ' s specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP]", "detok_text": "[CLS] star, singer michael russell, has been asked to increase his licence. [SEP] the fall is a good time in school. [SEP] had he sent his dog to buy his own car, the money would have gone. [SEP] in an interview, a senior official said the senator had refused to accept donations. [SEP] tougher guy. [SEP] the defence said that the incident was a breach of procedures made by the ministry of defence's specialist civil investigations department in 2002. [SEP] more consumers can visit or join the website and be reached at www. medgreent. com /. [SEP] for more information on iridium, visit the data center. [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] wouldn ' t be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company ' s board voted overwhelmingly in support of president obama ' s plans in iraq for the next six months, leaving at least $ 200 billion over two months of war time. [SEP] no, he didn ' t know all the extra money. [SEP] the proposed changes would undermine the core of the state ' s constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP]", "detok_text": "[CLS] wouldn't be a good idea to carry out a thorough review. [SEP] at a meeting on friday, the company's board voted overwhelmingly in support of president obama's plans in iraq for the next six months, leaving at least $200 billion over two months of war time. [SEP] no, he didn't know all the extra money. [SEP] the proposed changes would undermine the core of the state's constitutional law. [SEP] the spokesman said both sides would defend themselves as a matter of urgency. [SEP] during these opecunic events, many teachers, teachers, teachers and volunteers accompany men to the gym, and often [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $ 3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel ( 020 78777 ; www. explore. co. uk ), revenue & customs holidays ( 020 730000 ) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP]", "detok_text": "[CLS]swoman said prosecutors pursuing the case had no knowledge of the killings, and he might initiate a criminal investigation. [SEP] for the first time in a year, analysts have also warned that xstran may be worth more than the current $3 billion of debt. [SEP] police officers were being pushed at the door of houses where the killing took place. [SEP] it provides travel and family services run by international travel company british travel (020 78777; www. explore. co. uk), revenue & customs holidays (020 730000) and hotels and holidaymakers. [SEP] in the eight weeks since the crisis broke [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] \" the situation is that it will be improved, \" he said. [SEP] \" normally, ideally, people would see it later in the next month, doing it at least once a month, \" said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP]", "detok_text": "[CLS], oversee the iraqi security forces, and provide security for american and iraqi forces. [SEP] these could be added when they return to the commons in the capital. [SEP] \"the situation is that it will be improved,\" he said. [SEP] \"normally, ideally, people would see it later in the next month, doing it at least once a month,\" said johnson. [SEP] in may, bill murray voluntarily received a mental health treatment, according to a report by his north carolina office. [SEP] but eight people have been killed by police in the region. [SEP] and having won the british olympic and european cup titles in 2003, and second [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, \" and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff ' s department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP] \" it [SEP]", "detok_text": "[CLS] civilian judges, acting as the court of appeal. [SEP] at the busy railway station, the pilot collapsed in the rain in the early hours of the morning. [SEP] i lost my job because some people just lost, \"and it was followed by the long days of three to four hours. [SEP] david dungy, a spokesman for the sheriff's department, has said the prison chief believes the drug enforcement campaign could reduce the number of drug - related crime in the region. [SEP] he crawled out of the car, with his head covered in a blanket, then tried to wave it back to finish in a safe position. [SEP]\" it [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] prosecutors in the mclelland case review the federal grand jury ' s findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government ' s last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can ' t imagine texting a baby, or [SEP]", "detok_text": "[CLS] prosecutors in the mclelland case review the federal grand jury's findings and report into the death of stephen baker, whose body was discovered on march 2. [SEP] the government's last decision on the use of force was in 2007. [SEP] the children were taken from a school in sudbury, cambridgeshire, a week before 2200 bst that evening. [SEP] people in the midlands and surrounding areas have also taken part in extreme weather events. [SEP] it is also offering a working mortgage benefit scheme likely to cost £6 a week, starting at £345 a week. [SEP] if you can't imagine texting a baby, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] receive a guaranteed bonus of $ 4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] \" i ' ll tell you today, he ' s much more effective than now. [SEP] these institutions are not entirely strangers ; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP]", "detok_text": "[CLS] receive a guaranteed bonus of $4, 000 - - and paid full - time each month. [SEP] many fear water supplies hold up to their power facilities as they prepare for a strong storm. [SEP] i could not believe that he would ever get a bank loan. [SEP] he was fired, spokeswoman said. [SEP] \" i'll tell you today, he's much more effective than now. [SEP] these institutions are not entirely strangers; they can choose their own ways. [SEP] jones said he met with the defense minister, gen. jaullah mujahid, to discuss plans to push taliban militants from the eastern province of [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc ( goo. o ), microsoft corp ( ms. n ), google inc ( gooft. o, microsoft inc ' s top customer, and electric co inc ( ge. nx : quote, profile, research, stock buzz ) have announced plans to put net sales of $ 3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP]", "detok_text": "[CLS] the shooting is more likely to be the case. [SEP] an assistant is governor of alan s. rice of minnesota and the future administrator of the commission. [SEP] on wednesday, google co inc (goo. o), microsoft corp (ms. n), google inc ( gooft. o, microsoft inc's top customer, and electric co inc (ge. nx: quote, profile, research, stock buzz) have announced plans to put net sales of $3. 5 billion into securities trading securities related to the accounting charges. [SEP] this is an entirely new part of politics. [SEP] there was a sense among the public [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister ' s home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually \" on track \" for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP]", "detok_text": "[CLS] pakistan chief is believed to be the leading mastermind of the attacks. [SEP] but after a few weeks i stayed at my sister's home until it moved off. [SEP] sir mark, the long - retired air force officer of royal navy air, became the only aircraft carrier to have flown through the mediterranean to carry on his war plans for scotland. [SEP] posada was involved in three federal crimes, and was brought in a matter of months ago. [SEP] a month is usually \"on track\" for about 10 million dollars. [SEP] in 2003, microsoft refused to make a takeover bid. [SEP] the u. s. navy has launched [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] air, was deputy leader in russia ' s mi - 1 programme, and built russia ' s mirov ballistic missiles in addition to russia ' s first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama ' s 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP]", "detok_text": "[CLS] air, was deputy leader in russia's mi - 1 programme, and built russia's mirov ballistic missiles in addition to russia's first nuclear system. [SEP] jacksonville, fla. - the florida house said wednesday they passed a bill that ended the war four years ago, followed by a vote friday that would limit president obama's 10 - year - old build - up of the 550 us troops in iraq and 4, 000 troops in afghanistan. [SEP] district attorney william mccready asked the witness to testify in his testimony and later dismissed the suit. [SEP] in iowa, 34 per cent of democratic voters in the state [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush ' s failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP]", "detok_text": "[CLS] bank had not paid in mortgage charges, it was thought it would pay back about £54m in the quarter, which is due in full 2010. [SEP] i flew back to miami on an airlines flight. [SEP] the metropolitan police force has been investigated by three detectives and two other police officers in connection with the investigation. [SEP] the former republican presidential nominee often said the 2008 democratic presidential nominee was the father of u. s. president george w. bush's failed campaign. [SEP] it has been decided that stock, which may be worthless, may have been short - selling ordinary shares. [SEP] they cut off our electricity. [SEP] i ' [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won ' t be for long until you get water. [SEP] \" the difference between being a husband and being a mother now is clear. [SEP] but what [SEP]", "detok_text": "[CLS] 17 minutes remaining. [SEP] he also began working on wednesday and is mailing an internal psychiatric report. [SEP] the taliban have said in a statement following a meeting between the top leaders of the international human rights committee and the human rights council that there would be no international charges of violations against civilians. [SEP] b - 3 did not answer telephone calls for this article in april, the washington tribune reported. [SEP] but he is probably likely to find ground. [SEP] this ice will melt, and this won't be for long until you get water. [SEP] \" the difference between being a husband and being a mother now is clear. [SEP] but what [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said : \" this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department ' s report will not have historical significance and that \" if law [SEP]", "detok_text": "[CLS] slomping down the street for a coffee lunch. [SEP] on saturday, fa executive chairman pat wright said: \"this is a deeply serious accident and she understood the allegations were being investigated by this side. [SEP] the television and radio station has also launched a local programme that includes many of its regular programmes including daytime tv times and evening and evening news. [SEP] omar al - karzai was allegedly married to his mother and cousin when she was accused of killing her daughter and then forcing authorities to kill her, her family said. [SEP] but senate aides said the department's report will not have historical significance and that\" if law [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich ' s attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] \" when a e - mail or email address is sent to someone at birth, which i don ' t know [SEP]", "detok_text": "[CLS] a harvard student in college, was trying to come up with some sort of new idea. [SEP] nato officials said tuesday that the special representative to the u. n. security council on the 15 - nation council on afghanistan has staked the support of his staff members in a dispute with kabul over the proposed new law. [SEP] he has has been charged with blagevich's attempted murder. [SEP] in winter weeks, it was wet in the cold, but the area was infested with mud and cold soil. [SEP] \" when a e - mail or email address is sent to someone at birth, which i don't know [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university ' s college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] \" they want to... [SEP] he says that he \" has a lot of great points, \" but that he knows it is \" very good \" and does not believe this. [SEP] for all this time, it was in iceland ' s interest of nationalising its financial sector, and, of course, [SEP]", "detok_text": "[CLS] dead body in the pool at the school. [SEP] he joined the board in may 1958, retiring as a graduate professor at the university's college of management, where he was named a member of harvard medical school and chairman of the m. l. a. and of the international institute for health and health policy. [SEP] \"they want to... [SEP] he says that he\" has a lot of great points, \"but that he knows it is\" very good \" and does not believe this. [SEP] for all this time, it was in iceland's interest of nationalising its financial sector, and, of course, [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club ' s executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company ' s board, has made a $ 3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] \" there is no sense [SEP]", "detok_text": "[CLS] absence of any allegations of corruption in the legal system. [SEP] during the downturn, it was unclear what his life to do with his company. [SEP] in 1969, just three years after leaving as chairman of the club, he became the first individual football figure to conceive in the club's executive management. [SEP] mr shapiro, who has served as a top banker at toyota in the past for 13 years as the chairman of the company's board, has made a $3 million management package. [SEP] it was claimed the man took the phone while allegedly sending the phone message to his wife. [SEP] \" there is no sense [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] alaska ' s polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel ' s education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] \" it ' s an early day [SEP]", "detok_text": "[CLS] alaska's polar bears remain the most important source of information in the arctic area, and a significant source of the breeding population in the western arctic ice area. [SEP] soon after israel took over the presidency - - and a fifth head of state - - of the national arab university in 2005, israel's education department revoked its accreditation program. [SEP] but he has no doubt michael jones, the director of his new military team, will be meeting with the current head of the government. [SEP] officers said they took them to hospital for medical attention, but reported concerns about the identity of the man. [SEP] \" it's an early day [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP]", "detok_text": "[CLS] [SEP] i was at 14, aged only 15 when i turned 15 when i was 22, and i became aware of the need for more breathing time and this was the first time i had ever seen a particular level of interest. [SEP] one good dream for parents was to arrive at a post - office breakfast in the morning. [SEP] it might now make a zero percent interest rate cut, which is already the fastest rate cut in more than half a century. [SEP] he needs to say this. [SEP] the incident was reported to south wales police in swomford road at 2200 bst on tuesday, police said. [SEP] but we ' [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] rise of new zealand ' s fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he ' d scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan ' s authorities are saying [SEP]", "detok_text": "[CLS] rise of new zealand's fast food. [SEP] in the early war his firm was based in brecon, preselbury, and it was in westminster, highgate hill and cwmbran, where i turned up in the second row of hill houses, in edinburgh in 1975. [SEP] sir paul rose was appointed chairman of the met at the age of 81 for £2. 3 million but was paid £69, 000 in salary. [SEP] there are two good things in football. [SEP] he'd scored 16 points to help seattle give the league its first win of the regular season. [SEP] pakistan's authorities are saying [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] public freedom. \" [SEP] private sales opened last week at $ 12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that ' s what is an american school of american cooking, just as it ' s all about high - tech [SEP]", "detok_text": "[CLS] public freedom. \" [SEP] private sales opened last week at $12. 3m. [SEP] he said the decision before the new parliament is expected to make it a second session to parliament. [SEP] gordon - brown has been organized by the national museum of natural history. [SEP] the average rate again rises to 5. 3 points, falling to a peak of 5. 7 per cent in july, while the average rate on three year loans fell from 2. 7 per cent to 4. 5 per cent earlier in the year. [SEP] that's what is an american school of american cooking, just as it's all about high - tech [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i ' m a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP]", "detok_text": "[CLS] one of them. [SEP] in 1989, the kazlin democratic party of the anti - soviet union leader and finance chief, nikita khrushchev, launched a military campaign to stop attacks on the ussr in europe. [SEP] mr horwood, 29, was arrested friday, was granted bail but was released last month while the case was re - examined. [SEP] i'm a singer for several years. [SEP] 5, citing police officers. [SEP] experts say banks need to wait 10 days of payment of the cards but there may be a time when they are being forced to pay interest. [SEP] the story is still considered an accurate indicator [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring our soldiers into action, \" said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said : \" he ' s an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man ' s arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP]", "detok_text": "[CLS] be able to bring our soldiers into action, \"said col. david caldwell, vice chief for the u. s. air and air force. [SEP] the french army has more than 400 soldiers at more than 6, 000. [SEP] dein said:\" he's an added bonus to losing his team, but he can show that it can be done with live action, especially with steven jones. [SEP] police are pursuing a call for a man's arrest in connection with the murder of the 21 - year - old briton at a police station. [SEP] gen. pervez mullen, at a news conference tuesday, said [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs : hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP]", "detok_text": "[CLS] appeared in the oct. [SEP] some nato commanders in afghanistan have asked for the speed and deployment of most of the 21, 000 troops now already there. [SEP] the teenager was released on bail and bailed out following a review of the case. [SEP] he died, in 2003, but he was never able to die. [SEP] in november 2007, reflecting abundant demand in china and india, global demand for crude products more than doubled a month. [SEP] subs: hudson, fletcher, wolsay, langfield, coker, lovenk, fletcher, baird, banks, fletcher, lawes, fletcher, coker, healy, [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, the club ' s executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell ' s attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] \" we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving, \" he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP]", "detok_text": "[CLS] williams, the club's executive chairman. [SEP] more than 1, 000 women who lost weight in 2007 have been in the uk since 2000, according to a national survey. [SEP] i like the sound of the song. [SEP] the public prosecutor later refused to open the investigation, though campbell's attorney said no formal charges have been filed, the times of london reported. [SEP] a change of heart. [SEP] \"we entered an open area and the driver opened a side door and then tried to get under the car as it happened while driving,\" he said. [SEP] the army also plans to buy about 300, 000 cases of the [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] by 10 per cent. [SEP] that ' s all even more so, in their view, as they don ' t speak to their children. [SEP] the lakers didn ' t risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder ' s two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP]", "detok_text": "[CLS] by 10 per cent. [SEP] that's all even more so, in their view, as they don't speak to their children. [SEP] the lakers didn't risk a loss when andrej o, a backup who had six points in four regular seasons, took a poor win against dallas and spent at least 20 minutes sitting on his left leg. [SEP] chris snyder's two - run homer in the eighth and the first two runs made it 4 - 5. [SEP] they also help find evidence of what happened during a bonfire in the area on thursday. [SEP] he is still miles away from using the internet as a social service [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] up on his efforts to repeal the new people ' s law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant ' s main floor in the island ' s northern corner. [SEP] little rock, ark. [SEP]", "detok_text": "[CLS] up on his efforts to repeal the new people's law, which he says was never approved by the house and has said he will get the bill before christmas, but he opted instead to give up public responsibility for the election. [SEP] the local intelligence service had recently confirmed that the army in the area had killed militants. [SEP] it might not be the morning after that. [SEP] but his playing days were, for many, a clarion call for football this season. [SEP] she could also sell wineries and telephone jackpots on the restaurant's main floor in the island's northern corner. [SEP] little rock, ark. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it ' s not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world ' s top indian film director has taken charge of the country ' s budget, dropping his [SEP]", "detok_text": "[CLS] arrested on various charges, but they did not give a further date. [SEP] meanwhile, it's not so bad that all - rounders vaughan and swaner had already had to settle for one on the second morning in the second test. [SEP] najibullah - mujahid was under surveillance when police responded to his house after surrendering to his apartment by his security forces and security services, the times said. [SEP] the public inquiry team was unable to complete a report in both cases. [SEP] an actor in india who became the world's top indian film director has taken charge of the country's budget, dropping his [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it ' s always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series ; yes, he was [SEP]", "detok_text": "[CLS]. [SEP] her father was trapped in the front yard. [SEP] as the firefights started, people began beating up on the floor, hearing noises, an answer that was denied. [SEP] the group said the review would not be completed before the end of the current financial year and could be for a full year. [SEP] authorities reported the crash, 40 hours after a helicopter crash on the washington river. [SEP] it's always easy for both men to leave behind their job. [SEP] it was the first time former president nawaz sharif was available to comment. [SEP] that was to say the thrust of the series; yes, he was [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john ' s was still buried long after his death in 2 1 / 2 years ago. [SEP] it is the final day of parliament and the prime minister ' s funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] ( ap ) - - craig johnson held up his lead and was good [SEP]", "detok_text": "[CLS] are less likely to still need surgery following radical heart surgery, according to the group. [SEP] what a disgrace. [SEP] noose, the largest and most important of the leaders of the jewish state of israel, is still buried in the sanctuary of the middle eastern city of jerusalem, where st. john's was still buried long after his death in 2 1/2 years ago. [SEP] it is the final day of parliament and the prime minister's funeral. [SEP] the latest case has affected anyone under 18 and it was closed shortly after the crash incident. [SEP] (ap) - - craig johnson held up his lead and was good [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan ' s recent election, given \" today ' s announcement that the taliban [SEP]", "detok_text": "[CLS] and you can find us and have real fun. [SEP] the visitors again appeared to settle for a scoreless goal late in the second half. [SEP] mr winehouse was arrested in 1992 and later ran the child law enforcement office established in the 1990s. [SEP] he took advantage of his lack of vision, going back for treatment. [SEP] the case is expected to be heard before the general election in july 2009. [SEP] during the summer, he has to walk more leisurely. [SEP] the state of the afghan economy has been a key element of public support and support in afghanistan's recent election, given \" today's announcement that the taliban [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company ' s investor relations website ( www. wthrewcorp. com ) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP]", "detok_text": "[CLS] telephone at + 800 - 877 - 2526, or 617 - 213 - 2535. w. baird & co. interested listeners should visit the company's investor relations website (www. wthrewcorp. com) to listen via the web at 8003 - 1009 or + 919 798969 for a conference call, and enter pass code 86670998. access pass code 907771. www. dresser. net. com. is available by telephone from the u. s. relations section or calling on 0800 858989. [SEP] it was [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don ' t know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $ 100m through a payment system called the public service system ( csr [SEP]", "detok_text": "[CLS] charges, had been dismissed because of his involvement in federal criminal investigations. [SEP] the longer the military takes power, the more danger becomes. [SEP] now i don't know, but i thought it could last months and years, just in the middle of a big one. [SEP] police in the state have said they have no knowledge of his conduct. [SEP] christopher heilwood, 30, and his brother, gregory have been arrested following an incident between two youths at the store in abbey road, northampton, on saturday. [SEP] the authority said it had saved about $100m through a payment system called the public service system ( csr [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP]", "detok_text": "[CLS] murder and the assault was with one of the officers, authorities have said. [SEP] the finance ministry said the company had a plan to sell german products, but said it could put up many bidders for such brands. [SEP] but he denies that he has accused president zardari and others of compliciting in the election, and that he has not warned his citizens against raising confidence in the government. [SEP] that was an essential goal, she said, and it seemed that their relationship was taking on her new life. [SEP] 3, but the standard of living is likely to continue to drop. [SEP] it is a 50 - year [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great \" education. \" [SEP] i don ' t remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company ' s board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton ' s campaign [SEP]", "detok_text": "[CLS] mr brown said it was not simply a very bad social housing regime. [SEP] his successor, gen mullah muzi, was promoted to power when he received a british passport in 2001. [SEP] there is also a sense that the experience of his death in the 1980s was the day of great \"education.\" [SEP] i don't remember the music, but i listen to the world. [SEP] currently, he is a two - year member of the company's board. [SEP] born in 1992, texas tech has never been made the a. c. a. a. tournament again in three years. [SEP] bill clinton's campaign [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] \" you ' re not able to get work, you ' re out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP]", "detok_text": "[CLS]. [SEP] we do not need a laptop. [SEP] just three months ago, johnson was part of the team that felt the problem. [SEP] \" you're not able to get work, you're out of the workforce. [SEP] in 2009, gen. john gallimer and three co - defendants issued the district court order overturning the convictions of judge richard addington, who refused to testify in the case. [SEP] after the election, mr anwar announced that his brother had ended a management role in his charge of the police service of the state. [SEP] expect to see something similar again in the year, when the census of [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said : \" it ' s a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP]", "detok_text": "[CLS] to its requirements. [SEP] in september, japan they lost 0. 7 per cent. [SEP] they have given no details of their raids. [SEP] this is also a very serious issue. [SEP] david wilson, head of communication at the prison service trust union, said: \" it's a bit of a complete loss of confidence and confidence. [SEP] the officer, who is approved by the criminal register, said that he had no disciplinary record but was unable to answer questions until after they gave access to legal advice. [SEP] in december 1981, he was appointed chancellor of the university, and later, in 1986, a regular fellow at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai ' s brother, mr al - karzai ' s son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP]", "detok_text": "[CLS] president pervez musharraf, his predecessor, was removed under an emergency army rule. [SEP] this is a good decision so that it is more clear and effective. [SEP] western officials said at the opening session that mr karzai's brother, mr al - karzai's son, the director, houthi barzani - wali was present at the time of the blast, was released on sunday, after police demanded his arrest, the dawn newspaper reported. [SEP] sir michael powell, former head of the army and navy, was once a staff member of the george w. bush administration and is now [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP]", "detok_text": "[CLS] made to land in a car driven by his brother, who was walking away when the fire broke out in an open field near the spam hotel on the wrong side of the road. [SEP] he also dismissed claims that he was not a public figure who could be thought to have claimed to have been abused by a homeless person to get his money. [SEP] great article - - and, in fact, one crucial example. [SEP] government figures say the rise in cases means record numbers of abortions have been reported during the campaign. [SEP] the national front, the pdp, has been declared the winner, and the former prime minister, abdullah [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP]", "detok_text": "[CLS] the american football association. [SEP] under the scheme, a phone company can frighten you to buy the phone that can cost you and those looking to buy a card could make a payment. [SEP] four afghan insurgents were killed in a u. s. military helicopter crash during the campaign that destroyed hundreds of thousands of civilians and six insurgents hiding behind it. [SEP] more than 10, 000 children attend high - school lunch programs, more than 200 state schools and many others are facing food bills. [SEP] a police investigation has been launched after a firefighter has died at a house in lincolnshire. [SEP] president barack obama announced comprehensive reform for the health care [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP]", "detok_text": "[CLS] finals for the first time this year. [SEP] first, this had resulted in a massive pay - out - - but it was rejected by mps. [SEP] it has cut 700 jobs in the uk between april and april. [SEP] in the early sunday, over 100 people were found in collapsed or collapsed homes and three of those missing in the northwestern town of emu state. [SEP] georgia sent two combat troops on friday, the first time some 4, 500 troops were deployed to the area after fighting broke out in april. [SEP] just a few days later kazana blara announced she was looking to use public office just a few days [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP]", "detok_text": "[CLS] court in january, and one of two charges was dropped. [SEP] she has read this. [SEP] he already lives in alaska. [SEP] the australian funds rate, including bank rates, hit a five - year high for the dollar, which closed 0. 75 per cent lower at 0. 7 per cent on thursday, after dropping below 5 at an 18 - month high yesterday. [SEP] residents can call 0800 984 - 0830, and offers free £11 - a - day parking. [SEP] the u. s. military on friday accused the nato - led force of staging an air assault sunday night, saying it would send a heavy [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] \" i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP]", "detok_text": "[CLS] a big - screen show at the american pictures international film festival. [SEP] the legal authority developed by lord sir john burrell, who was appointed and by appointment as a deputy commissioner in 1992. [SEP] american michael phelps won his world record with an incompetent run in the 200 meters last night. [SEP] a few years ago, word emerged that blagojevich had launched a facebook campaign to raise money for the service. [SEP] \" i have made only one loan in five years. [SEP] this came after a teenager was also jailed for investigating the shooting of a woman in the dundee area. [SEP] the plan for the conservation area includes [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] \" it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force ' s chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP] \" those who know if there is any substance to this type of information were asked to back up up, \" he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] has left town. [SEP] she had no regrets, but her up - and - down routine was not quick enough. [SEP] \"it was too thick, he could not swim out because he was in the pool nearby. [SEP] sir bob woodward, the force's chief forces officer, said he had hoped to issue a schedule for deployment in april. [SEP]\" those who know if there is any substance to this type of information were asked to back up up, \" he said. [SEP] all are good, and are asked to give customers a number of help they really feel they might need or need it out. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $ 1. 7 billion of gold on its reserves as china, the world ' s second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP]", "detok_text": "[CLS] after allowing him to exchange text messages during his prison days. [SEP] the pandas will travel to american zoos during and after the season. [SEP] by the time he got his interview, he had helped his family and friends across the world. [SEP] his wife and children were also questioned for links in the investigation and he in aruban custody. [SEP] the chinese government said it issued $1. 7 billion of gold on its reserves as china, the world's second - largest economy, reported a five - year - long decline in gold reserves on friday. [SEP] under a five - year deal in which the club will receive £3 [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] $ 80 to $ 90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country ' s parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there ' s also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin ( d - mich. ) said that it was time for barack obama to take his post as president. [SEP] he was [SEP]", "detok_text": "[CLS] $80 to $90 per month. [SEP] his high - ranking deputy, circigio berto, said that it was not necessary for constitutional renewal of power in the country's parliament, seven years after mr. morales was suspended, offering all his colleagues the job. [SEP] there's also the growing range of local barbecue and pasta salads. [SEP] officials from the united nations, nato, china and russia each voiced their concerns, and last week u. s. sen carl m. levin (d - mich.) said that it was time for barack obama to take his post as president. [SEP] he was [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $ 100, 000 and the current bonus package worth $ 250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that \" direct complaints \" were not made and the plant ' s co - operation had to be closed. [SEP] a strasbourg court [SEP]", "detok_text": "[CLS] to adapt, and a growing number of foreign workers has been eliminated through the recruitment process. [SEP] the bank paid the bonuses this year with total bonuses of $100, 000 and the current bonus package worth $250 million. [SEP] and he too has been advised to find that his family is out of control because of its problems. [SEP] gordon smith, who was the us commander in iraq, says he believed his country was responsible for their deaths. [SEP] a spokeswoman for its petrochina unit said that \"direct complaints\" were not made and the plant's co - operation had to be closed. [SEP] a strasbourg court [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] \" we have already taken the measures to ensure the spread of flu is linked to improving care, \" the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP]", "detok_text": "[CLS] 2, 0 - 9 in the world cup games. [SEP] more than 100, 000 people died in a major earthquake off the coast of mexico in 2005. [SEP] the application is also being submitted to the meeting and the parliamentary health committee. [SEP] \"we have already taken the measures to ensure the spread of flu is linked to improving care,\" the hpc says, adding a further analysis is being carried out and the rest of the outbreak is likely to be confirmed. [SEP] he and his men served in the regular army and were sent to their homelands in iraq. [SEP] president obama pledged that he would consider whether to accept us forces [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan ' s pashtun in the south. [SEP] \" our manager ' s job to determine how it all happened to us, \" he said. [SEP] as one collector notes, \" he ' s kept going away for just about five years, \" he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP]", "detok_text": "[CLS] local and state sponsored public schools in phoenix, los angeles and chicago. [SEP] the case should be closed before dec. [SEP] a trial heard that he had been rejected but was quashed for three months. [SEP] at the top of the taliban, they face the battle with afghanistan's pashtun in the south. [SEP] \"our manager's job to determine how it all happened to us,\" he said. [SEP] as one collector notes, \"he's kept going away for just about five years,\" he said. [SEP] the brazilian later returned to action as the second half played five minutes and seven minutes. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin ' s 2008 vice presidential pick, launched a special inquiry into gov. palin ' s selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP]", "detok_text": "[CLS] find homes, go out of business and take a hike into the second - quarter comfort zone. [SEP] investigators were later told to give a police interview. [SEP] that will make it even harder to vote in future elections. [SEP] he became a sensation and was nominated for the award for natural science in a fellowship at the national academy of sciences in london. [SEP] palin, sarah palin's 2008 vice presidential pick, launched a special inquiry into gov. palin's selection as the presidential candidate, almost three years before the end of the summer. [SEP] starting at 15, mayes joined a group of u. s. sailors [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden ' s speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey ' s \" x [SEP]", "detok_text": "[CLS] as she said they had not heard of them. [SEP] a justice chief, deputy head of the domestic state committee and chief of national affairs were present when mr biden's speech was heard. [SEP] but mr manzanga said the current plan to legalise the practice is unsustainable. [SEP] bartoli is the no. 1 player to make the top three after last having to play first in the under - 21 open in april. [SEP] she met her husband when she had suffered from terminal cancer. [SEP] jones limped to a 2 - 3 fifth inning after losing control in the bottom. [SEP] grey's \" x [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] station, is to appear in magistrates ' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] \" the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let ' s not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP]", "detok_text": "[CLS] station, is to appear in magistrates' court after an anti - drugs programme last week, with ms ross saying she wanted to drop out of the cast of the tonight show. [SEP] \" the first half of the year in 2008 had two quarters of negative economic growth in this recession. [SEP] let's not forget whether he would coach the team when they reach the nfl championship. [SEP] the inquiry report also calls for a new public standard for takeovers. [SEP] what we will all know is that at £35, a week, he was being denied, at the age of 50, an early pension and decent home pay. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i ' m more likely to have been hit more than i ever thought. [SEP] the study also found [SEP]", "detok_text": "[CLS] [SEP] the cause of the outbreak, so far, is still providing details about the state of the supply, he said. [SEP] seven days later, he became the longest running fiction writer for television. [SEP] he has been jailed in the uk after the election in 2001, and agreed to release under the law of torture. [SEP] brian billiton, who entered the final three races in a row, was in the field along with johnson. [SEP] he said there will be no increase in the annual tax rate for five months. [SEP] then i'm more likely to have been hit more than i ever thought. [SEP] the study also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it ' s like a movie she ' s made. [SEP] he also asked john mcguinner, the scottish government ' s executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday ' s fourth - quarter performance. [SEP] but if a baby dies a few [SEP]", "detok_text": "[CLS] provide the final scoring opportunity in the 47th minute. [SEP] he says he hopes his client will sue the government so that they can do the same. [SEP] it's like a movie she's made. [SEP] he also asked john mcguinner, the scottish government's executive director, to set up a trust fund of more than £20m. [SEP] south africa will make their third tri six nations with a 32 - 17 win over new zealand, and will face the u. s. in june. [SEP] wal - mart was cautious after tuesday's fourth - quarter performance. [SEP] but if a baby dies a few [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes : joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service ' s office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP]", "detok_text": "[CLS] percent over last year, in a year - earlier period when it stood at 2, 661. [SEP] meanwhile, the european central bank kept the main interest rate at its lowest level amid concerns of the high inflation in the euro zone. [SEP] it said its cost rise was nearly 6 %, which rose to 1, 300 in 2006. [SEP] notes: joe johnson has seven points. [SEP] that way, power to a new government, or any state, should be appointed. [SEP] he had already received a letter from the public health service's office and told officials about the existence of the plans. [SEP] the security systems were put off [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun ' s comments to north american scientists have long been consistent. [SEP] not so many americans [SEP]", "detok_text": "[CLS] douglas huber and kevin spacey. [SEP] tomlinson, who lives in the maradona living room, asked what attracted his concern. [SEP] it takes time to take the first few months off when you would want to have a baby in your room sitting on the floor. [SEP] the financial cost of this case is very small. [SEP] celtic association legend john kelly says he could find himself in the hunt. [SEP] as a member of the pan - american advisory committee of the national trade and energy council and its foreign trade committee, hahn - chun's comments to north american scientists have long been consistent. [SEP] not so many americans [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] months. [SEP] in line with the national service ' s plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain ' s institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP]", "detok_text": "[CLS] months. [SEP] in line with the national service's plan, announced in april, the bbc is to be offering up to 1 million per - minute programmes for about 10 % of the digital audience. [SEP] the chief of police and chief of the national human security division, mullah mohammad qalinaza, were also wounded. [SEP] every year, while around 7, 000 americans die, there are now nearly 3. 9 million deaths per person, according to britain's institute of public health medicine. [SEP] he told police that the tape was a threat to one of his children. [SEP] mr. dean was not released named, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house ' s roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP]", "detok_text": "[CLS] jail after serving nine months and a half of his sentence, and suspended for three years. [SEP] although, after serving in power in the late 1980s, the british officer joined his unit in august 1975, while mr colle had spent nearly 30 years in the royal armoured service division, he was involved in the mid - morning operations and late - night operations of the military. [SEP] it appears there are people working at other sites on the channel island. [SEP] the other young man was trapped on the house's roof. [SEP] mccain has moved on, and he has never been a candidate in the fall. [SEP] but it gave him the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don ' t know - - or can ' t have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, \" war on evil. \" [SEP] \" you can see i had the car down on the back to myself. [SEP] \" when [SEP]", "detok_text": "[CLS] the money went down. [SEP] the board was due to vote on this issue next january. [SEP] the pakistani government has denied opposition claims that western forces are pursuing the taliban in a major border clash. [SEP] i feel very happy to make them no more. [SEP] they don't know - - or can't have kids when they want to. [SEP] it is an attempt of a sense of purpose that is part of the european parliament within the european convention of human rights. [SEP] one of the good books, \"war on evil.\" [SEP] \"you can see i had the car down on the back to myself. [SEP]\" when [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year ' s pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world ' s new best - in - class car [SEP]", "detok_text": "[CLS] staff, met mr. bush in january. [SEP] please, avoid the adulterous garb. [SEP] last year's pre - tax profits fell more than 9 per cent as a result of a weak yen, led by weaker demand. [SEP] this is currently at about £300, 000 a year - - a profit of around 2p a day on a year ago instead of the 40p pay of £7. 8 billion. [SEP] police released a short - range missile and a local television station reported that two militants had been killed in the latest rocket attack. [SEP] consider the world's new best - in - class car [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] t get enough to be angry, \" he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants ' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase, \" long gone. \" [SEP] in a [SEP]", "detok_text": "[CLS] t get enough to be angry, \"he wrote in his book, four days before he took a journalism course, declaring that an e. o. k. mandate would make the difference. [SEP] the u. s. - led coalition says at least 20 militants, most of them children, on both sides and the u. s. military said several taliban fighters were killed. [SEP] the militants' forces lost their way, and the army said a soldier was killed when insurgents launched a land mine in the area. [SEP] i only went to the garden, and must have heard the french phrase,\" long gone. \" [SEP] in a [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain ' s air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] \" despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits, \" said richard shepherd, the mpc ' s chief economist, [SEP]", "detok_text": "[CLS] and several years after his parents were involved in the crime - - disappeared for six hours on 23 may 2007. [SEP] three of them spent 15 years in britain's air force prison system and there was no indication that any changes in the command of the forces were made by bush because of his concern over the operational nature of their actions. [SEP] the social security and welfare services are expected to be discussed in the european parliament. [SEP] \"despite the fact that the base rate has risen, helped by recent rate cuts, the current base interest rate is not taking any hits,\" said richard shepherd, the mpc's chief economist, [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS]. [SEP] appearing in a programme - programme on bbc ' s morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king ' s college of new church in inverness and king ' s church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP]", "detok_text": "[CLS]. [SEP] appearing in a programme - programme on bbc's morning live, mr morgan compared the achievements of sir james when he was a deputy bbc northern ireland in the 1990s. [SEP] several people were evacuated on other days of the course, she said. [SEP] the former episcopal school of meningia and king's college of new church in inverness and king's church is to be sold as part of the reorganisation of the national anglican church of scotland. [SEP] the two victims were later killed in an accident in france and spain. [SEP] they said six people have also contacted police to make dna evidence for him, and he is asking [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn ' t he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke ' s successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP]", "detok_text": "[CLS] 1968, died and was again five days later, appearing on the bbc programme for a series of non - programmes. [SEP] if your father had a problem with my son, why didn't he choose to do the thing? [SEP] boston won the pac - 10 series for the first time since 1992 before winning first - round games in chicago. [SEP] but mr. finke's successor, ben w. c. fleming, chairman of the bank and a member of the board, backed mr. morgan. [SEP] they appealed for help. [SEP] mr. chirac was also ousted after several years in office - - he was sworn in [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p45_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p45_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..701d6d1fa06f8a849f8a55bc71dccca732147b88 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p45_detok_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top16_ft0p45_detok +{ + "type": "summary", + "name": "sample_top16_ft0p45", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top16_ft0p45", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.45, + "top_k": 16, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p45_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p45_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..7a8517bb10b5d4fc86fb35e188e5b751df54dd66 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p45_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top16_ft0p45 +{ + "type": "summary", + "name": "sample_top16_ft0p45", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top16_ft0p45", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.45, + "top_k": 16, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p45_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p45_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..030bccd359aac2e45edb699500dc900136453f86 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p45_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "sample_top16_ft0p45", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "sample_top16_ft0p45", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "sample", "final_temp": 0.45, "top_k": 16, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 1.0, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p55_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p55_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..d7ac1c3300164afaaa6010d289abf1b38f471e1a --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p55_detok_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top16_ft0p55_detok +{ + "type": "summary", + "name": "sample_top16_ft0p55", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top16_ft0p55", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.55, + "top_k": 16, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p55_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p55_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..185cf1682577e5e461be66e673f95e1bfe2e6762 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p55_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top16_ft0p55 +{ + "type": "summary", + "name": "sample_top16_ft0p55", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top16_ft0p55", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.55, + "top_k": 16, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p55_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p55_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..2b78c2cbbde069aee8848e171b9fa795a775f0ca --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p55_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "sample_top16_ft0p55", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "sample_top16_ft0p55", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "sample", "final_temp": 0.55, "top_k": 16, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 1.0, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p65_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p65_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..006a5e8e0817fa92467a57699c7bb9b25b4d285a --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p65_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top16_ft0p65 +{ + "type": "summary", + "name": "sample_top16_ft0p65", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top16_ft0p65", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.65, + "top_k": 16, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p65_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p65_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..a4916a806764b32b99b2d5b8a27280fcff60e260 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p65_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "sample_top16_ft0p65", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "sample_top16_ft0p65", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "sample", "final_temp": 0.65, "top_k": 16, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 1.0, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p75_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p75_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..8c553bf147d49fc9efab53963d97e68206f3c5c1 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p75_detok_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top16_ft0p75_detok +{ + "type": "summary", + "name": "sample_top16_ft0p75", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top16_ft0p75", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.75, + "top_k": 16, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.10606027020915, + "nll_per_token": 3.8524016609026415, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1993, + "token_count": 8192, + "distinct_1": 0.2432861328125, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p75_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p75_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..b2cf86ece507d3d8dcb1b1e8481e2c8ceb9f3986 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p75_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top16_ft0p75 +{ + "type": "summary", + "name": "sample_top16_ft0p75", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top16_ft0p75", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.75, + "top_k": 16, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.10606027020915, + "nll_per_token": 3.8524016609026415, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1993, + "token_count": 8192, + "distinct_1": 0.2432861328125, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p75_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p75_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..1ffece7019307fc305f375206af4a44bbcf70df0 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p75_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "sample_top16_ft0p75", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "sample_top16_ft0p75", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "sample", "final_temp": 0.75, "top_k": 16, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 1.0, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.10606027020915, "nll_per_token": 3.8524016609026415, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1993, "token_count": 8192, "distinct_1": 0.2432861328125, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p9_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p9_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..a877f794398957b809c1fecc0ab4c0e84945032d --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p9_detok_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top16_ft0p9_detok +{ + "type": "summary", + "name": "sample_top16_ft0p9", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top16_ft0p9", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.9, + "top_k": 16, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.20680496915697, + "nll_per_token": 3.85453805527493, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1994, + "token_count": 8192, + "distinct_1": 0.243408203125, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupilsvard jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p9_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p9_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..9b5763216d25a0d862ca6e5041e2295bec5541a0 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p9_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top16_ft0p9 +{ + "type": "summary", + "name": "sample_top16_ft0p9", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top16_ft0p9", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.9, + "top_k": 16, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.20680496915697, + "nll_per_token": 3.85453805527493, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1994, + "token_count": 8192, + "distinct_1": 0.243408203125, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupilsvard jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p9_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p9_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..31aaf2477688e1bce77df41cb4a47d30a43c4a53 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top16_ft0p9_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "sample_top16_ft0p9", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "sample_top16_ft0p9", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "sample", "final_temp": 0.9, "top_k": 16, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 1.0, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.20680496915697, "nll_per_token": 3.85453805527493, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1994, "token_count": 8192, "distinct_1": 0.243408203125, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupilsvard jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupilsvard jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p45_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p45_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..a04894ae0101c9366523822a2d42063feebe8da1 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p45_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top32_ft0p45 +{ + "type": "summary", + "name": "sample_top32_ft0p45", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top32_ft0p45", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.45, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p45_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p45_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..7963e47a8ad045b75a22a6d1577792fdaa533013 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p45_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "sample_top32_ft0p45", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "sample_top32_ft0p45", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "sample", "final_temp": 0.45, "top_k": 32, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 1.0, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p55_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p55_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..1b0910b250f7388eaaf0be4520d0a4e48ccefdcb --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p55_detok_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top32_ft0p55_detok +{ + "type": "summary", + "name": "sample_top32_ft0p55", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top32_ft0p55", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.55, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p55_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p55_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..3dbf2b4b6f18714a8848d47774cdb314bf424721 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p55_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "sample_top32_ft0p55", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "sample_top32_ft0p55", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "sample", "final_temp": 0.55, "top_k": 32, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 1.0, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p65_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p65_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..0791c81fee7a146f8667511fe7d2d207fa447091 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p65_detok_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top32_ft0p65_detok +{ + "type": "summary", + "name": "sample_top32_ft0p65", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top32_ft0p65", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.65, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p65_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p65_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..dccc991423950e0ad9bc4ffc6a689c09fb7a4bbc --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p65_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top32_ft0p65 +{ + "type": "summary", + "name": "sample_top32_ft0p65", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top32_ft0p65", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.65, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p65_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p65_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..f37805d9155f40b6cc1ce668cdf86dabb96d4de0 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p65_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "sample_top32_ft0p65", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "sample_top32_ft0p65", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "sample", "final_temp": 0.65, "top_k": 32, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 1.0, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p75_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p75_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..e4a192fff2cdb7000dc1199945402e55f3a1cad5 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p75_detok_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top32_ft0p75_detok +{ + "type": "summary", + "name": "sample_top32_ft0p75", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top32_ft0p75", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.75, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.10606027020915, + "nll_per_token": 3.8524016609026415, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1993, + "token_count": 8192, + "distinct_1": 0.2432861328125, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p75_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p75_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..548c51b6fd1242dbea421d65c540773909aaf5d3 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p75_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top32_ft0p75 +{ + "type": "summary", + "name": "sample_top32_ft0p75", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top32_ft0p75", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.75, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.10606027020915, + "nll_per_token": 3.8524016609026415, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1993, + "token_count": 8192, + "distinct_1": 0.2432861328125, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p75_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p75_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..0dc6ca5154c8c723e28d1aad90737a6c4030bdad --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p75_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "sample_top32_ft0p75", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "sample_top32_ft0p75", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "sample", "final_temp": 0.75, "top_k": 32, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 1.0, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.10606027020915, "nll_per_token": 3.8524016609026415, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1993, "token_count": 8192, "distinct_1": 0.2432861328125, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p9_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p9_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..727077048006c9624ed20a28af759f74be0b5949 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p9_detok_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top32_ft0p9_detok +{ + "type": "summary", + "name": "sample_top32_ft0p9", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top32_ft0p9", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.9, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.20680496915697, + "nll_per_token": 3.85453805527493, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1994, + "token_count": 8192, + "distinct_1": 0.243408203125, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupilsvard jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p9_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p9_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..764972bed2884b924605476e15db939368b9ddd0 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p9_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top32_ft0p9 +{ + "type": "summary", + "name": "sample_top32_ft0p9", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top32_ft0p9", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.9, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.20680496915697, + "nll_per_token": 3.85453805527493, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1994, + "token_count": 8192, + "distinct_1": 0.243408203125, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupilsvard jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p9_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p9_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..e1def778b2e50781f76086335a6962da5809cf92 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top32_ft0p9_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "sample_top32_ft0p9", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "sample_top32_ft0p9", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "sample", "final_temp": 0.9, "top_k": 32, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 1.0, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.20680496915697, "nll_per_token": 3.85453805527493, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1994, "token_count": 8192, "distinct_1": 0.243408203125, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupilsvard jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupilsvard jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p45_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p45_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..e1629444d272d5f7c64ce95976703c90ba28dc4e --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p45_detok_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top64_ft0p45_detok +{ + "type": "summary", + "name": "sample_top64_ft0p45", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top64_ft0p45", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.45, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p45_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p45_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..33e22e11fe30a88070e21a535108de8f9014ec4c --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p45_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top64_ft0p45 +{ + "type": "summary", + "name": "sample_top64_ft0p45", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top64_ft0p45", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.45, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p45_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p45_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..e413024a11715131ecf206aa6feb223960f92347 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p45_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "sample_top64_ft0p45", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "sample_top64_ft0p45", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "sample", "final_temp": 0.45, "top_k": 64, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 1.0, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p55_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p55_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..a3b71385772987f0014580607cd755aaca8d515e --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p55_detok_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top64_ft0p55_detok +{ + "type": "summary", + "name": "sample_top64_ft0p55", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top64_ft0p55", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.55, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p55_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p55_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..10f1e4e4872ca932d756982da57dddcc89e0c14b --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p55_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top64_ft0p55 +{ + "type": "summary", + "name": "sample_top64_ft0p55", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top64_ft0p55", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.55, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p55_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p55_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..2b7938c07239279434d89b24ed095e9d1a5bb9c1 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p55_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "sample_top64_ft0p55", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "sample_top64_ft0p55", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "sample", "final_temp": 0.55, "top_k": 64, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 1.0, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p65_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p65_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..e56f1d2fa5ddbd9e0e7c3d1f838272aa7997cc6c --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p65_detok_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top64_ft0p65_detok +{ + "type": "summary", + "name": "sample_top64_ft0p65", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top64_ft0p65", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.65, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p65_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p65_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..a242dbe700d1b2fc61a4806e917aeb089ad2e0ac --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p65_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top64_ft0p65 +{ + "type": "summary", + "name": "sample_top64_ft0p65", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top64_ft0p65", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.65, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p65_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p65_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..9fc6f7d763f93be0a6bc5e23fabd4621d2ccf773 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p65_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "sample_top64_ft0p65", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "sample_top64_ft0p65", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "sample", "final_temp": 0.65, "top_k": 64, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 1.0, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p75_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p75_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..012f3f6207ce82309c7c8be3b236df1ce0fe8093 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p75_detok_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top64_ft0p75_detok +{ + "type": "summary", + "name": "sample_top64_ft0p75", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top64_ft0p75", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.75, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.10606027020915, + "nll_per_token": 3.8524016609026415, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1993, + "token_count": 8192, + "distinct_1": 0.2432861328125, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p75_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p75_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..796654e922cfe58d5de5928c3e700411d1a6624b --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p75_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top64_ft0p75 +{ + "type": "summary", + "name": "sample_top64_ft0p75", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top64_ft0p75", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.75, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.10606027020915, + "nll_per_token": 3.8524016609026415, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1993, + "token_count": 8192, + "distinct_1": 0.2432861328125, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p9_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p9_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..a3ac3e2cb8a207e4379523a25dfb62f627987c28 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p9_detok_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top64_ft0p9_detok +{ + "type": "summary", + "name": "sample_top64_ft0p9", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top64_ft0p9", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.9, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.20680496915697, + "nll_per_token": 3.85453805527493, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1994, + "token_count": 8192, + "distinct_1": 0.243408203125, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupilsvard jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p9_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p9_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..fe8c8eddacc4c4721b5a6e05b0b83e60b327ace4 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top64_ft0p9_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "sample_top64_ft0p9", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "sample_top64_ft0p9", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "sample", "final_temp": 0.9, "top_k": 64, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 1.0, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.20680496915697, "nll_per_token": 3.85453805527493, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1994, "token_count": 8192, "distinct_1": 0.243408203125, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupilsvard jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupilsvard jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p45_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p45_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..3625e59a5ca9925781b3af0d7989c4b64a1014ce --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p45_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top8_ft0p45 +{ + "type": "summary", + "name": "sample_top8_ft0p45", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top8_ft0p45", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.45, + "top_k": 8, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p45_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p45_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..3522e1146f2e16a02cfb82e206c55487b8122ea7 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p45_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "sample_top8_ft0p45", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "sample_top8_ft0p45", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "sample", "final_temp": 0.45, "top_k": 8, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 1.0, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p55_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p55_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..a005b44e6dd0a9b0baa6ccd8840263ef8e32ac42 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p55_detok_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top8_ft0p55_detok +{ + "type": "summary", + "name": "sample_top8_ft0p55", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top8_ft0p55", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.55, + "top_k": 8, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p55_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p55_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..36ae1f240869ffcaca995e498ad0c3948fb6dc10 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p55_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top8_ft0p55 +{ + "type": "summary", + "name": "sample_top8_ft0p55", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top8_ft0p55", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.55, + "top_k": 8, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p65_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p65_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..d386aa52a96e6e65dad43224eaaa1ae250ff873a --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p65_detok_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top8_ft0p65_detok +{ + "type": "summary", + "name": "sample_top8_ft0p65", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top8_ft0p65", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.65, + "top_k": 8, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p65_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p65_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..83d5d604e9c3ca1ed996420f7fbf905ded50da27 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p65_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top8_ft0p65 +{ + "type": "summary", + "name": "sample_top8_ft0p65", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top8_ft0p65", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.65, + "top_k": 8, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p65_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p65_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..72cc7a4ddfe9433b68c4ac6f0dd6b37325e698f4 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p65_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "sample_top8_ft0p65", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "sample_top8_ft0p65", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "sample", "final_temp": 0.65, "top_k": 8, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 1.0, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p75_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p75_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..95ce3f6955b9e2d49b5c17d297f51862b6341dd2 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p75_detok_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top8_ft0p75_detok +{ + "type": "summary", + "name": "sample_top8_ft0p75", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top8_ft0p75", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.75, + "top_k": 8, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.10606027020915, + "nll_per_token": 3.8524016609026415, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1993, + "token_count": 8192, + "distinct_1": 0.2432861328125, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p75_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p75_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..2faaaf8d1733a15a78c9200840767b0ab874e4e3 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p75_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "sample_top8_ft0p75", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "sample_top8_ft0p75", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "sample", "final_temp": 0.75, "top_k": 8, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 1.0, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.10606027020915, "nll_per_token": 3.8524016609026415, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1993, "token_count": 8192, "distinct_1": 0.2432861328125, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p9_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p9_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..c3a87b2fe9199745b33f7b591c4efeff9a47307d --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p9_raw_samples.txt @@ -0,0 +1,236 @@ +sample_top8_ft0p9 +{ + "type": "summary", + "name": "sample_top8_ft0p9", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "sample_top8_ft0p9", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "sample", + "final_temp": 0.9, + "top_k": 8, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 1.0, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.20680496915697, + "nll_per_token": 3.85453805527493, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1994, + "token_count": 8192, + "distinct_1": 0.243408203125, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupilsvard jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p9_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p9_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..a49768f08236cbb053fd41c3dbb4d1ecbfb48bcd --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sample_top8_ft0p9_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "sample_top8_ft0p9", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "sample_top8_ft0p9", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "sample", "final_temp": 0.9, "top_k": 8, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 1.0, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.20680496915697, "nll_per_token": 3.85453805527493, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1994, "token_count": 8192, "distinct_1": 0.243408203125, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a succeed loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupilsvard jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupilsvard jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sorted_by_detok_genppl.tsv b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sorted_by_detok_genppl.tsv new file mode 100644 index 0000000000000000000000000000000000000000..efa66e6c406a734eb87b5dd4f03d66118af3fc95 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sorted_by_detok_genppl.tsv @@ -0,0 +1,57 @@ +name step detok_genppl sample_entropy distinct_1 distinct_2 top_token_mass temp_start temp_end temp_schedule t_power eta0 eta_schedule noise_conc concentration_max final_from final_mode final_temp top_k top_p uniform_mix sample_threshold +const_thrs_tau0p12_top32 200000 41.80839195562669 4.204396875108297 0.2371826171875 0.7140748031496063 0.0560302734375 1.45 1.45 const 1.0 0.12 early_cosine 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.12 +const_thrs_tau0p12_top64 200000 41.80839195562669 4.204396875108297 0.2371826171875 0.7140748031496063 0.0560302734375 1.45 1.45 const 1.0 0.12 early_cosine 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.12 +const_thrs_tau0p2_top32 200000 41.80839195562669 4.204396875108297 0.2371826171875 0.7140748031496063 0.0560302734375 1.45 1.45 const 1.0 0.12 early_cosine 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.2 +const_thrs_tau0p2_top64 200000 41.80839195562669 4.204396875108297 0.2371826171875 0.7140748031496063 0.0560302734375 1.45 1.45 const 1.0 0.12 early_cosine 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.2 +const_thrs_tau0p36_top32 200000 41.80839195562669 4.204396875108297 0.2371826171875 0.7140748031496063 0.0560302734375 1.45 1.45 const 1.0 0.12 early_cosine 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.36 +const_thrs_tau0p36_top64 200000 41.80839195562669 4.204396875108297 0.2371826171875 0.7140748031496063 0.0560302734375 1.45 1.45 const 1.0 0.12 early_cosine 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.36 +argmax_const1p45_noise_c256 200000 43.01780486436395 4.198717295568989 0.240966796875 0.7169045275590551 0.0582275390625 1.45 1.45 const 1.0 0.12 early_cosine 1.0 256.0 state argmax 1.0 0 0.0 0.0 1.0 +thrs_tau0p08_top16 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 16 0.0 0.0 0.08 +thrs_tau0p08_top32 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.08 +thrs_tau0p08_top64 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.08 +thrs_tau0p08_top128 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 128 0.0 0.0 0.08 +thrs_tau0p1_top16 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 16 0.0 0.0 0.1 +thrs_tau0p1_top32 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.1 +thrs_tau0p1_top64 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.1 +thrs_tau0p1_top128 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 128 0.0 0.0 0.1 +thrs_tau0p12_top16 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 16 0.0 0.0 0.12 +thrs_tau0p12_top32 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.12 +thrs_tau0p12_top64 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.12 +thrs_tau0p12_top128 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 128 0.0 0.0 0.12 +thrs_tau0p16_top16 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 16 0.0 0.0 0.16 +thrs_tau0p16_top32 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.16 +thrs_tau0p16_top64 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.16 +thrs_tau0p16_top128 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 128 0.0 0.0 0.16 +thrs_tau0p2_top16 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 16 0.0 0.0 0.2 +thrs_tau0p2_top32 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.2 +thrs_tau0p2_top64 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.2 +thrs_tau0p2_top128 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 128 0.0 0.0 0.2 +thrs_tau0p28_top16 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 16 0.0 0.0 0.28 +thrs_tau0p28_top32 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.28 +thrs_tau0p28_top64 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.28 +thrs_tau0p28_top128 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 128 0.0 0.0 0.28 +thrs_tau0p36_top16 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 16 0.0 0.0 0.36 +thrs_tau0p36_top32 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.36 +thrs_tau0p36_top64 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.36 +thrs_tau0p36_top128 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 128 0.0 0.0 0.36 +sample_top8_ft0p45 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.45 8 0.0 0.0 1.0 +sample_top16_ft0p45 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.45 16 0.0 0.0 1.0 +sample_top32_ft0p45 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.45 32 0.0 0.0 1.0 +sample_top64_ft0p45 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.45 64 0.0 0.0 1.0 +sample_top8_ft0p55 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.55 8 0.0 0.0 1.0 +sample_top16_ft0p55 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.55 16 0.0 0.0 1.0 +sample_top32_ft0p55 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.55 32 0.0 0.0 1.0 +sample_top64_ft0p55 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.55 64 0.0 0.0 1.0 +sample_top8_ft0p65 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.65 8 0.0 0.0 1.0 +sample_top16_ft0p65 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.65 16 0.0 0.0 1.0 +sample_top32_ft0p65 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.65 32 0.0 0.0 1.0 +sample_top64_ft0p65 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.65 64 0.0 0.0 1.0 +sample_top8_ft0p75 200000 47.10606027020915 4.234723586801034 0.2432861328125 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.75 8 0.0 0.0 1.0 +sample_top16_ft0p75 200000 47.10606027020915 4.234723586801034 0.2432861328125 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.75 16 0.0 0.0 1.0 +sample_top32_ft0p75 200000 47.10606027020915 4.234723586801034 0.2432861328125 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.75 32 0.0 0.0 1.0 +sample_top64_ft0p75 200000 47.10606027020915 4.234723586801034 0.2432861328125 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.75 64 0.0 0.0 1.0 +sample_top8_ft0p9 200000 47.20680496915697 4.234723586801034 0.243408203125 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.9 8 0.0 0.0 1.0 +sample_top16_ft0p9 200000 47.20680496915697 4.234723586801034 0.243408203125 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.9 16 0.0 0.0 1.0 +sample_top32_ft0p9 200000 47.20680496915697 4.234723586801034 0.243408203125 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.9 32 0.0 0.0 1.0 +sample_top64_ft0p9 200000 47.20680496915697 4.234723586801034 0.243408203125 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.9 64 0.0 0.0 1.0 +argmax_linear2to08_noise_c256 200000 47.59276914535052 4.213223813400032 0.2396240234375 0.7229330708661418 0.060302734375 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state argmax 1.0 0 0.0 0.0 1.0 diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sorted_by_sample_entropy.tsv b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sorted_by_sample_entropy.tsv new file mode 100644 index 0000000000000000000000000000000000000000..0011708db7cec509f9161be291640709d248f981 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/sorted_by_sample_entropy.tsv @@ -0,0 +1,57 @@ +name step detok_genppl sample_entropy distinct_1 distinct_2 top_token_mass temp_start temp_end temp_schedule t_power eta0 eta_schedule noise_conc concentration_max final_from final_mode final_temp top_k top_p uniform_mix sample_threshold +thrs_tau0p08_top16 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 16 0.0 0.0 0.08 +thrs_tau0p08_top32 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.08 +thrs_tau0p08_top64 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.08 +thrs_tau0p08_top128 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 128 0.0 0.0 0.08 +thrs_tau0p1_top16 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 16 0.0 0.0 0.1 +thrs_tau0p1_top32 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.1 +thrs_tau0p1_top64 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.1 +thrs_tau0p1_top128 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 128 0.0 0.0 0.1 +thrs_tau0p12_top16 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 16 0.0 0.0 0.12 +thrs_tau0p12_top32 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.12 +thrs_tau0p12_top64 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.12 +thrs_tau0p12_top128 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 128 0.0 0.0 0.12 +thrs_tau0p16_top16 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 16 0.0 0.0 0.16 +thrs_tau0p16_top32 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.16 +thrs_tau0p16_top64 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.16 +thrs_tau0p16_top128 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 128 0.0 0.0 0.16 +thrs_tau0p2_top16 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 16 0.0 0.0 0.2 +thrs_tau0p2_top32 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.2 +thrs_tau0p2_top64 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.2 +thrs_tau0p2_top128 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 128 0.0 0.0 0.2 +thrs_tau0p28_top16 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 16 0.0 0.0 0.28 +thrs_tau0p28_top32 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.28 +thrs_tau0p28_top64 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.28 +thrs_tau0p28_top128 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 128 0.0 0.0 0.28 +thrs_tau0p36_top16 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 16 0.0 0.0 0.36 +thrs_tau0p36_top32 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.36 +thrs_tau0p36_top64 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.36 +thrs_tau0p36_top128 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 128 0.0 0.0 0.36 +sample_top8_ft0p45 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.45 8 0.0 0.0 1.0 +sample_top16_ft0p45 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.45 16 0.0 0.0 1.0 +sample_top32_ft0p45 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.45 32 0.0 0.0 1.0 +sample_top64_ft0p45 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.45 64 0.0 0.0 1.0 +sample_top8_ft0p55 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.55 8 0.0 0.0 1.0 +sample_top16_ft0p55 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.55 16 0.0 0.0 1.0 +sample_top32_ft0p55 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.55 32 0.0 0.0 1.0 +sample_top64_ft0p55 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.55 64 0.0 0.0 1.0 +sample_top8_ft0p65 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.65 8 0.0 0.0 1.0 +sample_top16_ft0p65 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.65 16 0.0 0.0 1.0 +sample_top32_ft0p65 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.65 32 0.0 0.0 1.0 +sample_top64_ft0p65 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.65 64 0.0 0.0 1.0 +sample_top8_ft0p75 200000 47.10606027020915 4.234723586801034 0.2432861328125 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.75 8 0.0 0.0 1.0 +sample_top16_ft0p75 200000 47.10606027020915 4.234723586801034 0.2432861328125 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.75 16 0.0 0.0 1.0 +sample_top32_ft0p75 200000 47.10606027020915 4.234723586801034 0.2432861328125 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.75 32 0.0 0.0 1.0 +sample_top64_ft0p75 200000 47.10606027020915 4.234723586801034 0.2432861328125 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.75 64 0.0 0.0 1.0 +sample_top8_ft0p9 200000 47.20680496915697 4.234723586801034 0.243408203125 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.9 8 0.0 0.0 1.0 +sample_top16_ft0p9 200000 47.20680496915697 4.234723586801034 0.243408203125 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.9 16 0.0 0.0 1.0 +sample_top32_ft0p9 200000 47.20680496915697 4.234723586801034 0.243408203125 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.9 32 0.0 0.0 1.0 +sample_top64_ft0p9 200000 47.20680496915697 4.234723586801034 0.243408203125 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.9 64 0.0 0.0 1.0 +argmax_linear2to08_noise_c256 200000 47.59276914535052 4.213223813400032 0.2396240234375 0.7229330708661418 0.060302734375 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state argmax 1.0 0 0.0 0.0 1.0 +const_thrs_tau0p12_top32 200000 41.80839195562669 4.204396875108297 0.2371826171875 0.7140748031496063 0.0560302734375 1.45 1.45 const 1.0 0.12 early_cosine 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.12 +const_thrs_tau0p12_top64 200000 41.80839195562669 4.204396875108297 0.2371826171875 0.7140748031496063 0.0560302734375 1.45 1.45 const 1.0 0.12 early_cosine 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.12 +const_thrs_tau0p2_top32 200000 41.80839195562669 4.204396875108297 0.2371826171875 0.7140748031496063 0.0560302734375 1.45 1.45 const 1.0 0.12 early_cosine 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.2 +const_thrs_tau0p2_top64 200000 41.80839195562669 4.204396875108297 0.2371826171875 0.7140748031496063 0.0560302734375 1.45 1.45 const 1.0 0.12 early_cosine 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.2 +const_thrs_tau0p36_top32 200000 41.80839195562669 4.204396875108297 0.2371826171875 0.7140748031496063 0.0560302734375 1.45 1.45 const 1.0 0.12 early_cosine 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.36 +const_thrs_tau0p36_top64 200000 41.80839195562669 4.204396875108297 0.2371826171875 0.7140748031496063 0.0560302734375 1.45 1.45 const 1.0 0.12 early_cosine 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.36 +argmax_const1p45_noise_c256 200000 43.01780486436395 4.198717295568989 0.240966796875 0.7169045275590551 0.0582275390625 1.45 1.45 const 1.0 0.12 early_cosine 1.0 256.0 state argmax 1.0 0 0.0 0.0 1.0 diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/summary.tsv b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/summary.tsv new file mode 100644 index 0000000000000000000000000000000000000000..c5b67697d2a57874ab62d39ce607648dd26bc2ce --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/summary.tsv @@ -0,0 +1,57 @@ +name step detok_genppl sample_entropy distinct_1 distinct_2 top_token_mass temp_start temp_end temp_schedule t_power eta0 eta_schedule noise_conc concentration_max final_from final_mode final_temp top_k top_p uniform_mix sample_threshold +argmax_linear2to08_noise_c256 200000 47.59276914535052 4.213223813400032 0.2396240234375 0.7229330708661418 0.060302734375 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state argmax 1.0 0 0.0 0.0 1.0 +argmax_const1p45_noise_c256 200000 43.01780486436395 4.198717295568989 0.240966796875 0.7169045275590551 0.0582275390625 1.45 1.45 const 1.0 0.12 early_cosine 1.0 256.0 state argmax 1.0 0 0.0 0.0 1.0 +thrs_tau0p08_top16 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 16 0.0 0.0 0.08 +thrs_tau0p08_top32 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.08 +thrs_tau0p08_top64 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.08 +thrs_tau0p08_top128 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 128 0.0 0.0 0.08 +thrs_tau0p1_top16 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 16 0.0 0.0 0.1 +thrs_tau0p1_top32 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.1 +thrs_tau0p1_top64 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.1 +thrs_tau0p1_top128 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 128 0.0 0.0 0.1 +thrs_tau0p12_top16 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 16 0.0 0.0 0.12 +thrs_tau0p12_top32 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.12 +thrs_tau0p12_top64 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.12 +thrs_tau0p12_top128 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 128 0.0 0.0 0.12 +thrs_tau0p16_top16 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 16 0.0 0.0 0.16 +thrs_tau0p16_top32 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.16 +thrs_tau0p16_top64 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.16 +thrs_tau0p16_top128 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 128 0.0 0.0 0.16 +thrs_tau0p2_top16 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 16 0.0 0.0 0.2 +thrs_tau0p2_top32 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.2 +thrs_tau0p2_top64 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.2 +thrs_tau0p2_top128 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 128 0.0 0.0 0.2 +thrs_tau0p28_top16 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 16 0.0 0.0 0.28 +thrs_tau0p28_top32 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.28 +thrs_tau0p28_top64 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.28 +thrs_tau0p28_top128 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 128 0.0 0.0 0.28 +thrs_tau0p36_top16 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 16 0.0 0.0 0.36 +thrs_tau0p36_top32 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.36 +thrs_tau0p36_top64 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.36 +thrs_tau0p36_top128 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state threshold_sample 1.0 128 0.0 0.0 0.36 +sample_top8_ft0p45 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.45 8 0.0 0.0 1.0 +sample_top16_ft0p45 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.45 16 0.0 0.0 1.0 +sample_top32_ft0p45 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.45 32 0.0 0.0 1.0 +sample_top64_ft0p45 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.45 64 0.0 0.0 1.0 +sample_top8_ft0p55 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.55 8 0.0 0.0 1.0 +sample_top16_ft0p55 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.55 16 0.0 0.0 1.0 +sample_top32_ft0p55 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.55 32 0.0 0.0 1.0 +sample_top64_ft0p55 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.55 64 0.0 0.0 1.0 +sample_top8_ft0p65 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.65 8 0.0 0.0 1.0 +sample_top16_ft0p65 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.65 16 0.0 0.0 1.0 +sample_top32_ft0p65 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.65 32 0.0 0.0 1.0 +sample_top64_ft0p65 200000 47.05610793061529 4.234723586801034 0.2431640625 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.65 64 0.0 0.0 1.0 +sample_top8_ft0p75 200000 47.10606027020915 4.234723586801034 0.2432861328125 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.75 8 0.0 0.0 1.0 +sample_top16_ft0p75 200000 47.10606027020915 4.234723586801034 0.2432861328125 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.75 16 0.0 0.0 1.0 +sample_top32_ft0p75 200000 47.10606027020915 4.234723586801034 0.2432861328125 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.75 32 0.0 0.0 1.0 +sample_top64_ft0p75 200000 47.10606027020915 4.234723586801034 0.2432861328125 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.75 64 0.0 0.0 1.0 +sample_top8_ft0p9 200000 47.20680496915697 4.234723586801034 0.243408203125 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.9 8 0.0 0.0 1.0 +sample_top16_ft0p9 200000 47.20680496915697 4.234723586801034 0.243408203125 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.9 16 0.0 0.0 1.0 +sample_top32_ft0p9 200000 47.20680496915697 4.234723586801034 0.243408203125 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.9 32 0.0 0.0 1.0 +sample_top64_ft0p9 200000 47.20680496915697 4.234723586801034 0.243408203125 0.7299458661417323 0.056640625 2.0 0.8 linear 1.0 0.12 early_linear 1.0 256.0 state sample 0.9 64 0.0 0.0 1.0 +const_thrs_tau0p12_top32 200000 41.80839195562669 4.204396875108297 0.2371826171875 0.7140748031496063 0.0560302734375 1.45 1.45 const 1.0 0.12 early_cosine 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.12 +const_thrs_tau0p12_top64 200000 41.80839195562669 4.204396875108297 0.2371826171875 0.7140748031496063 0.0560302734375 1.45 1.45 const 1.0 0.12 early_cosine 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.12 +const_thrs_tau0p2_top32 200000 41.80839195562669 4.204396875108297 0.2371826171875 0.7140748031496063 0.0560302734375 1.45 1.45 const 1.0 0.12 early_cosine 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.2 +const_thrs_tau0p2_top64 200000 41.80839195562669 4.204396875108297 0.2371826171875 0.7140748031496063 0.0560302734375 1.45 1.45 const 1.0 0.12 early_cosine 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.2 +const_thrs_tau0p36_top32 200000 41.80839195562669 4.204396875108297 0.2371826171875 0.7140748031496063 0.0560302734375 1.45 1.45 const 1.0 0.12 early_cosine 1.0 256.0 state threshold_sample 1.0 32 0.0 0.0 0.36 +const_thrs_tau0p36_top64 200000 41.80839195562669 4.204396875108297 0.2371826171875 0.7140748031496063 0.0560302734375 1.45 1.45 const 1.0 0.12 early_cosine 1.0 256.0 state threshold_sample 1.0 64 0.0 0.0 0.36 diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top128_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top128_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..a1b239b789f9bef98065a57f4649cbfc945b9fbe --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top128_detok_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p08_top128_detok +{ + "type": "summary", + "name": "thrs_tau0p08_top128", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p08_top128", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 128, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.08, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top128_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top128_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..0aefb2c36a108f8e0714d2577871e7d114c3a7f5 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top128_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p08_top128 +{ + "type": "summary", + "name": "thrs_tau0p08_top128", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p08_top128", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 128, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.08, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top128_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top128_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..de817c20413f30af81ec881f9e8ed3f2884ed58e --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top128_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "thrs_tau0p08_top128", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "thrs_tau0p08_top128", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 128, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.08, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top16_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top16_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..19cad406ec66e59770e75d956274db0db1514215 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top16_detok_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p08_top16_detok +{ + "type": "summary", + "name": "thrs_tau0p08_top16", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p08_top16", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 16, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.08, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top16_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top16_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..199347e13e197d19c871904b4dad40157f70d73b --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top16_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p08_top16 +{ + "type": "summary", + "name": "thrs_tau0p08_top16", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p08_top16", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 16, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.08, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top16_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top16_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..24b00b988873b269afc04512adebe0a6237e5fae --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top16_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "thrs_tau0p08_top16", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "thrs_tau0p08_top16", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 16, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.08, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top32_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top32_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..ad99b5870787955380c1306c8542aa92ef354566 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top32_detok_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p08_top32_detok +{ + "type": "summary", + "name": "thrs_tau0p08_top32", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p08_top32", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.08, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top32_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top32_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..a0e663cabc1291d4ad33986993542a4f972c4e32 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top32_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p08_top32 +{ + "type": "summary", + "name": "thrs_tau0p08_top32", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p08_top32", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.08, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top32_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top32_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..182f5c615eda713881ee080c80ea94aa1ce0dafb --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top32_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "thrs_tau0p08_top32", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "thrs_tau0p08_top32", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 32, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.08, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top64_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top64_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..7082727d5b517592d84ac7882d7271dfead39240 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top64_detok_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p08_top64_detok +{ + "type": "summary", + "name": "thrs_tau0p08_top64", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p08_top64", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.08, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top64_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top64_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..cad5b4be58ffcf960b571c68196c08ca98e8f043 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top64_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p08_top64 +{ + "type": "summary", + "name": "thrs_tau0p08_top64", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p08_top64", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.08, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top64_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top64_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..8f850c67a66888b48ea18a2207c46e5831e1dd98 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p08_top64_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "thrs_tau0p08_top64", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "thrs_tau0p08_top64", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 64, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.08, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top128_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top128_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..37f61d86bbefb036ca568dea62ea484f833f3add --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top128_detok_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p12_top128_detok +{ + "type": "summary", + "name": "thrs_tau0p12_top128", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p12_top128", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 128, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.12, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top128_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top128_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..4acbef6fc83e03ffd0cbb97a6e1f31c89552fdba --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top128_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p12_top128 +{ + "type": "summary", + "name": "thrs_tau0p12_top128", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p12_top128", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 128, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.12, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top128_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top128_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..ff1326de61ab5ab8e9d8dea98055d4d1a6fb4cfb --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top128_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "thrs_tau0p12_top128", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "thrs_tau0p12_top128", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 128, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.12, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top16_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top16_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..5b305c82019b055ce323a86ed321b70005925a98 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top16_detok_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p12_top16_detok +{ + "type": "summary", + "name": "thrs_tau0p12_top16", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p12_top16", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 16, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.12, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top16_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top16_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..7f3ba30bd400c8760133aaf629b28497e72b0273 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top16_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p12_top16 +{ + "type": "summary", + "name": "thrs_tau0p12_top16", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p12_top16", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 16, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.12, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top16_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top16_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..9c03710f7d6ad060d0b0b3c9db4495149ba8cc5d --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top16_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "thrs_tau0p12_top16", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "thrs_tau0p12_top16", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 16, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.12, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top32_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top32_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..b31a713947cf734cfdd3fe663e533e9bdcbe7815 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top32_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p12_top32 +{ + "type": "summary", + "name": "thrs_tau0p12_top32", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p12_top32", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.12, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top32_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top32_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..b8667abe8661bee2372837a26ad551808dff3f5b --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top32_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "thrs_tau0p12_top32", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "thrs_tau0p12_top32", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 32, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.12, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top64_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top64_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..8c4af06ae33ef0fa1c0d78fb46fbba819c37a69b --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top64_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p12_top64 +{ + "type": "summary", + "name": "thrs_tau0p12_top64", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p12_top64", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.12, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top64_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top64_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..01b18a540d5b7538113bbc2134110e746b2042b6 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p12_top64_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "thrs_tau0p12_top64", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "thrs_tau0p12_top64", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 64, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.12, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top128_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top128_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..f56569d85fe0ca03440a7563e45fbff6a0f118d4 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top128_detok_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p16_top128_detok +{ + "type": "summary", + "name": "thrs_tau0p16_top128", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p16_top128", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 128, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.16, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top128_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top128_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..3370d3f5fa238907bb89e2c341ef9c52caf21406 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top128_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p16_top128 +{ + "type": "summary", + "name": "thrs_tau0p16_top128", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p16_top128", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 128, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.16, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top128_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top128_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..9a33145aecc6945efe36ea78716b18ff8b043877 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top128_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "thrs_tau0p16_top128", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "thrs_tau0p16_top128", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 128, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.16, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top16_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top16_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..433eb6149eee051c2e8067e89b061b5cae944b31 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top16_detok_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p16_top16_detok +{ + "type": "summary", + "name": "thrs_tau0p16_top16", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p16_top16", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 16, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.16, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top16_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top16_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..2724ec7fcdb03ef20fd289673bafed8e76d6ef59 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top16_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p16_top16 +{ + "type": "summary", + "name": "thrs_tau0p16_top16", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p16_top16", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 16, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.16, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top16_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top16_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..c1a3e003ab5a5c104359cac886365fe4a7f8581e --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top16_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "thrs_tau0p16_top16", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "thrs_tau0p16_top16", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 16, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.16, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top32_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top32_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..2c1577883008aa3d65e370c3a1dc9ea50c9873c5 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top32_detok_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p16_top32_detok +{ + "type": "summary", + "name": "thrs_tau0p16_top32", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p16_top32", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.16, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top32_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top32_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..43a0762d6770ff75e90894982e670b1bcfd03e57 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top32_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p16_top32 +{ + "type": "summary", + "name": "thrs_tau0p16_top32", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p16_top32", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.16, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top32_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top32_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..0ec7cabe7cfc9ba8e7ab3f7e80d5508b5c8002ff --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top32_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "thrs_tau0p16_top32", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "thrs_tau0p16_top32", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 32, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.16, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top64_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top64_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..10803806f67245e3d825a37331742b47eee4870a --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top64_detok_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p16_top64_detok +{ + "type": "summary", + "name": "thrs_tau0p16_top64", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p16_top64", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.16, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top64_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top64_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..9ba243895e1ae52f32d2073269d62775a88610bc --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p16_top64_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p16_top64 +{ + "type": "summary", + "name": "thrs_tau0p16_top64", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p16_top64", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.16, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top128_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top128_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..9b51cccfaeaf2514b9867840e1feb888b09711ca --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top128_detok_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p1_top128_detok +{ + "type": "summary", + "name": "thrs_tau0p1_top128", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p1_top128", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 128, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.1, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top128_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top128_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..66a9959d72383d1e7517ead47574886dddd7904c --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top128_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p1_top128 +{ + "type": "summary", + "name": "thrs_tau0p1_top128", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p1_top128", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 128, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.1, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top128_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top128_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..6deb1cfce662926d0d1eaf2651a58a151cba8e99 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top128_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "thrs_tau0p1_top128", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "thrs_tau0p1_top128", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 128, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.1, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top16_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top16_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..875385db8dd6e4b8819b547c53cca719342ddd63 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top16_detok_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p1_top16_detok +{ + "type": "summary", + "name": "thrs_tau0p1_top16", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p1_top16", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 16, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.1, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top16_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top16_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..22d11c4428657d363e0dee4e8c3266e5419c40bc --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top16_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p1_top16 +{ + "type": "summary", + "name": "thrs_tau0p1_top16", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p1_top16", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 16, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.1, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top32_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top32_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..fcfa31dc2a1b88e86af35e69d34d61d5d22d3538 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top32_detok_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p1_top32_detok +{ + "type": "summary", + "name": "thrs_tau0p1_top32", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p1_top32", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.1, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top32_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top32_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..abef17e7038b17c4db7dc8250c8dd9788f3b357e --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top32_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p1_top32 +{ + "type": "summary", + "name": "thrs_tau0p1_top32", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p1_top32", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.1, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top64_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top64_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..feb097dde02b7df28a5369200187f289349083eb --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top64_detok_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p1_top64_detok +{ + "type": "summary", + "name": "thrs_tau0p1_top64", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p1_top64", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.1, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top64_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top64_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..f5eb5e31ccdc840c582c34a68e3dc4b77dc80693 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top64_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p1_top64 +{ + "type": "summary", + "name": "thrs_tau0p1_top64", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p1_top64", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.1, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top64_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top64_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..6eefede032e6419b7ab9acd05ea0ad20f68b1283 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p1_top64_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "thrs_tau0p1_top64", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "thrs_tau0p1_top64", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 64, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.1, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top128_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top128_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..c0c04fac3f31ae9cc3ea1535379367ee053b19ed --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top128_detok_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p28_top128_detok +{ + "type": "summary", + "name": "thrs_tau0p28_top128", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p28_top128", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 128, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.28, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top128_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top128_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..9c94ea281c9fd2a0522a9a54d22cfce21ba6c967 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top128_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p28_top128 +{ + "type": "summary", + "name": "thrs_tau0p28_top128", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p28_top128", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 128, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.28, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top128_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top128_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..c6b5438de4e8acb220dbb7853b4982c4bcd03a56 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top128_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "thrs_tau0p28_top128", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "thrs_tau0p28_top128", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 128, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.28, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top16_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top16_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..32be07a582108e02f10505863792e5fdb5aaf9aa --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top16_detok_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p28_top16_detok +{ + "type": "summary", + "name": "thrs_tau0p28_top16", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p28_top16", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 16, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.28, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top16_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top16_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..c7d3970700bc84ad7073a0ed5b376950b56dfe44 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top16_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p28_top16 +{ + "type": "summary", + "name": "thrs_tau0p28_top16", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p28_top16", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 16, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.28, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top16_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top16_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..aef8cba70169d604ecc382a8b603180ead5abc49 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top16_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "thrs_tau0p28_top16", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "thrs_tau0p28_top16", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 16, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.28, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top32_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top32_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..6abb9d574eb1b4d41751f11bc6eca35f5bf26990 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top32_detok_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p28_top32_detok +{ + "type": "summary", + "name": "thrs_tau0p28_top32", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p28_top32", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.28, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top32_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top32_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..5b4300b776c8dfc629452e44ccd2567dd54815e2 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top32_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p28_top32 +{ + "type": "summary", + "name": "thrs_tau0p28_top32", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p28_top32", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.28, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top64_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top64_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..79d99e29b5d46e28040f69afe13abd9fd3a17079 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top64_detok_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p28_top64_detok +{ + "type": "summary", + "name": "thrs_tau0p28_top64", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p28_top64", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.28, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top64_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top64_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..ae88c5c87f5a567277f289645a4d420f9c86283f --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top64_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p28_top64 +{ + "type": "summary", + "name": "thrs_tau0p28_top64", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p28_top64", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.28, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top64_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top64_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..5bc1205a087a9ef13348ca58f98e9d94362329d3 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p28_top64_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "thrs_tau0p28_top64", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "thrs_tau0p28_top64", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 64, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.28, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top128_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top128_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..173ba837ea7b81a4f65167b6be1797606ffeac44 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top128_detok_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p2_top128_detok +{ + "type": "summary", + "name": "thrs_tau0p2_top128", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p2_top128", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 128, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.2, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top128_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top128_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..d21ecaf0c8ce89c770e6c5ea81da4f6a0dfc3456 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top128_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p2_top128 +{ + "type": "summary", + "name": "thrs_tau0p2_top128", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p2_top128", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 128, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.2, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top128_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top128_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..191c2637c85d4d900af173519d0bab7dda1db07c --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top128_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "thrs_tau0p2_top128", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "thrs_tau0p2_top128", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 128, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.2, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top16_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top16_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..fc44d3548c66dee78e33d82bd9e96ebd98b6add0 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top16_detok_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p2_top16_detok +{ + "type": "summary", + "name": "thrs_tau0p2_top16", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p2_top16", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 16, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.2, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top16_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top16_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..8108faf32bcafb09ef00e53968d7c4cb8ff10b3e --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top16_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p2_top16 +{ + "type": "summary", + "name": "thrs_tau0p2_top16", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p2_top16", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 16, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.2, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top16_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top16_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..91e91b0e25528e78515909e3938dabfcb7ec37c5 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top16_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "thrs_tau0p2_top16", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "thrs_tau0p2_top16", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 16, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.2, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top32_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top32_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..2f03768775284c182c359624ec2ccad28eceebb8 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top32_detok_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p2_top32_detok +{ + "type": "summary", + "name": "thrs_tau0p2_top32", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p2_top32", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.2, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top32_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top32_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..9db66da2172047ff177e2db949bc94e60b1fa094 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top32_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p2_top32 +{ + "type": "summary", + "name": "thrs_tau0p2_top32", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p2_top32", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.2, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top64_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top64_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..9cb08dfc2faee0d13b933520a053b035d52df0ed --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top64_detok_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p2_top64_detok +{ + "type": "summary", + "name": "thrs_tau0p2_top64", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p2_top64", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.2, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top64_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top64_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..7c0801d530220a881549aeac7646eb52868b5071 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top64_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p2_top64 +{ + "type": "summary", + "name": "thrs_tau0p2_top64", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p2_top64", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.2, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top64_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top64_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..ca3ffd6ad03c6e13258ba77c4dbc6c5eb8f50021 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p2_top64_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "thrs_tau0p2_top64", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "thrs_tau0p2_top64", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 64, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.2, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top128_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top128_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..c03d5ec473542877f98d220bc3064a7d929dfd73 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top128_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p36_top128 +{ + "type": "summary", + "name": "thrs_tau0p36_top128", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p36_top128", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 128, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.36, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top128_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top128_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..348330bcbe03a8efb272f3d7cfe844f7721a79a4 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top128_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "thrs_tau0p36_top128", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "thrs_tau0p36_top128", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 128, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.36, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top16_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top16_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..0ea02c38ccf5aa70dfe16e5672693dca4511d418 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top16_detok_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p36_top16_detok +{ + "type": "summary", + "name": "thrs_tau0p36_top16", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p36_top16", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 16, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.36, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top16_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top16_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..76f1934e606686c25a4e780f583f5b255bd52bac --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top16_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p36_top16 +{ + "type": "summary", + "name": "thrs_tau0p36_top16", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p36_top16", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 16, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.36, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top16_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top16_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..d9f51f219fe9f2491aca5256887a22fd52321a76 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top16_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "thrs_tau0p36_top16", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "thrs_tau0p36_top16", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 16, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.36, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top32_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top32_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..1e03dd59e78f3cf3f652c2655ba60b63561669f5 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top32_detok_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p36_top32_detok +{ + "type": "summary", + "name": "thrs_tau0p36_top32", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p36_top32", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.36, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top32_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top32_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..b1a06d6edcc81dafe68f75331d7a37c8ab4b451d --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top32_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p36_top32 +{ + "type": "summary", + "name": "thrs_tau0p36_top32", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p36_top32", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 32, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.36, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top32_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top32_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..2b63a306db209580cba0950034cf38dd2ece5bad --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top32_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "thrs_tau0p36_top32", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "thrs_tau0p36_top32", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 32, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.36, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top64_detok_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top64_detok_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..e84a9f84f0c341c55c44c10056060dc56ab1287a --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top64_detok_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p36_top64_detok +{ + "type": "summary", + "name": "thrs_tau0p36_top64", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p36_top64", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.36, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of "heat," which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - "30 rock's hard rock concert" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current "residual" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] "maybe, of course," six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as "the prince" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] "it's normal and i'm just waiting to be found convinced that it works," says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] "you're lucky and may get a few weeks," said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is "no evidence whatsoever that it was made public." [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was "live in six months," it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] "i heard that the police were called to the house of the family home and the answer was" no i'll be away. " [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, "you do know what to make of a data camera" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i'd leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] "the election that was not credible appears to be conducted by security authorities," said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] "he was here for america to come," obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: " it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a "routine case" [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called "russia's internal law," previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] "if the evidence is compelling we will conclude that all of this evidence is a criminal crime," the statement said. [SEP] "their joint function is not good," said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online "world's e - band" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an "unspecified amount of time" during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a "big challenge" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] "there were no preclinious remarks at him, he was never found to accept that position," the judge said. [SEP] " all of it's floating around the [SEP] + +===== sample 058 ===== +[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the "short of the full protocol" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as "offensive and common sense." [SEP] "the good morning news" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's "daily news" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top64_raw_samples.txt b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top64_raw_samples.txt new file mode 100644 index 0000000000000000000000000000000000000000..cb17037008d813807215e39adb516a26dfbb0beb --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top64_raw_samples.txt @@ -0,0 +1,236 @@ +thrs_tau0p36_top64 +{ + "type": "summary", + "name": "thrs_tau0p36_top64", + "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", + "step": 200000, + "decode": { + "kind": "categorical_fullvocab_final_sampling_push43", + "config": "thrs_tau0p36_top64", + "steps": 128, + "temp_start": 2.0, + "temp_end": 0.8, + "temp_schedule": "linear", + "t_power": 1.0, + "eta0": 0.12, + "eta_schedule": "early_linear", + "noise_conc": 1.0, + "concentration_max": 256.0, + "final_from": "state", + "update": "resample", + "final_mode": "threshold_sample", + "final_temp": 1.0, + "top_k": 64, + "top_p": 0.0, + "uniform_mix": 0.0, + "sample_threshold": 0.36, + "n_samples": 64, + "seed": 20260508 + }, + "detok_genppl": { + "ppl": 47.05610793061529, + "nll_per_token": 3.8513406754722035, + "tokens": 9682 + }, + "diversity": { + "sample_entropy": 4.234723586801034, + "unique_tokens": 1992, + "token_count": 8192, + "distinct_1": 0.2431640625, + "distinct_2": 0.7299458661417323, + "top_token_mass": 0.056640625 + } +} + +===== sample 000 ===== +[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP] + +===== sample 001 ===== +[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of " heat, " which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP] + +===== sample 002 ===== +[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : " certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP] + +===== sample 003 ===== +[CLS]. [SEP] " he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP] + +===== sample 004 ===== +[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - " 30 rock ' s hard rock concert " bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP] + +===== sample 005 ===== +[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP] + +===== sample 006 ===== +[CLS] cities will bring them more reliable supply over the next few years, " said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP] + +===== sample 007 ===== +[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] " i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP] + +===== sample 008 ===== +[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current " residual " taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP] + +===== sample 009 ===== +[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] " maybe, of course, " six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as " the prince " was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP] + +===== sample 010 ===== +[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP] + +===== sample 011 ===== +[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP] + +===== sample 012 ===== +[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] " the difference between their interest rates and your charge - credit level in the next period will [SEP] + +===== sample 013 ===== +[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that " if in [SEP] + +===== sample 014 ===== +[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] " it ' s normal and i ' m just waiting to be found convinced that it works, " says dr [SEP] + +===== sample 015 ===== +[CLS]ic body in the world food energy agency. [SEP] " you ' re lucky and may get a few weeks, " said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP] + +===== sample 016 ===== +[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP] + +===== sample 017 ===== +[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP] + +===== sample 018 ===== +[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP] + +===== sample 019 ===== +[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is " no evidence whatsoever that it was made public. " [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP] + +===== sample 020 ===== +[CLS] world freedom. " [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP] + +===== sample 021 ===== +[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP] + +===== sample 022 ===== +[CLS] be able to bring the driver into custody, " said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP] + +===== sample 023 ===== +[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP] + +===== sample 024 ===== +[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was " live in six months, " it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP] + +===== sample 025 ===== +[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP] + +===== sample 026 ===== +[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP] + +===== sample 027 ===== +[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] " i heard that the police were called to the house of the family home and the answer was " no i ' ll be away. " [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP] + +===== sample 028 ===== +[CLS] financial market trouble, " chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP] + +===== sample 029 ===== +[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP] + +===== sample 030 ===== +[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that " fighting [SEP] + +===== sample 031 ===== +[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP] + +===== sample 032 ===== +[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, " you do know what to make of a data camera " - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] " he has really been around for a good long time so i ' d leave home soon [SEP] + +===== sample 033 ===== +[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP] + +===== sample 034 ===== +[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP] + +===== sample 035 ===== +[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] " the election that was not credible appears to be conducted by security authorities, " said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP] + +===== sample 036 ===== +[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP] + +===== sample 037 ===== +[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP] + +===== sample 038 ===== +[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP] + +===== sample 039 ===== +[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP] + +===== sample 040 ===== +[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP] + +===== sample 041 ===== +[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP] + +===== sample 042 ===== +[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] " he was here for america to come, " obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP] + +===== sample 043 ===== +[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP] + +===== sample 044 ===== +[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : " it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP] + +===== sample 045 ===== +[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a " routine case " [SEP] + +===== sample 046 ===== +[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called " russia ' s internal law, " previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP] + +===== sample 047 ===== +[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] " if the evidence is compelling we will conclude that all of this evidence is a criminal crime, " the statement said. [SEP] " their joint function is not good, " said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP] + +===== sample 048 ===== +[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online " world ' s e - band " or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP] + +===== sample 049 ===== +[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP] + +===== sample 050 ===== +[CLS] involved making sure they had no time to trade cars. " [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP] + +===== sample 051 ===== +[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an " unspecified amount of time " during the upcoming election. [SEP] " he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP] + +===== sample 052 ===== +[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP] + +===== sample 053 ===== +[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP] + +===== sample 054 ===== +[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP] + +===== sample 055 ===== +[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : " we have a number of differences between the us and the [SEP] + +===== sample 056 ===== +[CLS] british personnel arriving in afghanistan are expected to add a " big challenge " among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP] + +===== sample 057 ===== +[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] " there were no preclinious remarks at him, he was never found to accept that position, " the judge said. [SEP] " all of it ' s floating around the [SEP] + +===== sample 058 ===== +[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the " short of the full protocol " that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP] + +===== sample 059 ===== +[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] " this [SEP] + +===== sample 060 ===== +[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP] + +===== sample 061 ===== +[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP] + +===== sample 062 ===== +[CLS] as " offensive and common sense. " [SEP] " the good morning news " john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s " daily news " saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP] + +===== sample 063 ===== +[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP] + diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top64_scored.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top64_scored.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..2c40e5c895d6a78d284f26316c2a4e911ae90208 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260508/lm1b_8gpu_fullycoupled_step200k_final_sampling_push43_focused_128steps_n64/thrs_tau0p36_top64_scored.jsonl @@ -0,0 +1,65 @@ +{"type": "summary", "name": "thrs_tau0p36_top64", "checkpoint": "runs/lta_lm1b_dirichlet_categorical_fullvocab_c1024_fullycoupled_flmpack_onehot_hardce_ddit_small_len128_gbs512_8gpu_1m_nw0/step_0200000.pt", "step": 200000, "decode": {"kind": "categorical_fullvocab_final_sampling_push43", "config": "thrs_tau0p36_top64", "steps": 128, "temp_start": 2.0, "temp_end": 0.8, "temp_schedule": "linear", "t_power": 1.0, "eta0": 0.12, "eta_schedule": "early_linear", "noise_conc": 1.0, "concentration_max": 256.0, "final_from": "state", "update": "resample", "final_mode": "threshold_sample", "final_temp": 1.0, "top_k": 64, "top_p": 0.0, "uniform_mix": 0.0, "sample_threshold": 0.36, "n_samples": 64, "seed": 20260508}, "detok_genppl": {"ppl": 47.05610793061529, "nll_per_token": 3.8513406754722035, "tokens": 9682}, "diversity": {"sample_entropy": 4.234723586801034, "unique_tokens": 1992, "token_count": 8192, "distinct_1": 0.2431640625, "distinct_2": 0.7299458661417323, "top_token_mass": 0.056640625}} +{"type": "sample", "index": 0, "raw_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can ' t be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1 ' s little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]", "detok_text": "[CLS] england players will have to put in extra time before their football gets used to the results. [SEP] but this can't be surprising - - they will take a long, and perhaps longer, look at it. [SEP] more recently he returned to the bbc studio, designing the fat boy short breakfast show and taking a guest screen role on bbc1's little britain programme and was nominated in the british television awards. [SEP] 8, will take about eight weeks to prepare. [SEP] i had no idea of what i was doing on business. [SEP] the driver had gone to his house about 4am, where it happened when he left his house [SEP]"} +{"type": "sample", "index": 1, "raw_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \" heat, \" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]", "detok_text": "[CLS] under the criminal domestic security agency program, according to an internal report filed by the inspector general of the state police department. [SEP] sir thomas took his job as the director - general - he set up the work and equal pay commission - - and his subsequent predecessor resigned after he refused to accept changes. [SEP] take an hour. [SEP] lawyers have been active in the latest of hundreds of legal action against the ministry of defence over a delay in orders to be published. [SEP] but there is at least a bit of \"heat,\" which could be a problem with free speech. [SEP] for more information on the program, visit the galen center, [SEP]"} +{"type": "sample", "index": 2, "raw_text": "[CLS] sunday ' s poll and is unable to find out a candidate for his party in the election next year. [SEP] there ' s just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn ' t spent all the extra resources. [SEP] alex ferguson said : \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]", "detok_text": "[CLS] sunday's poll and is unable to find out a candidate for his party in the election next year. [SEP] there's just a question as to when not to be in bed on saturday. [SEP] the new legislation, introduced in june, guarantees up to two months of prison time. [SEP] it said it hasn't spent all the extra resources. [SEP] alex ferguson said: \" certain games of the champions league have been limited. [SEP] a day later wednesday, she was called to answer questions about whether a child had been shot by the officer in the building and whether she had received the e - mail from the police police department. [SEP]"} +{"type": "sample", "index": 3, "raw_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]", "detok_text": "[CLS]. [SEP] \" he made remarks he had to stand by the victim, and says he could not speak to. [SEP] the first daughter moved the next year and she had previously been together at age 28 for a year. [SEP] the men were expected to face charges. [SEP] he took his first name off the list of five candidates for the november election. [SEP] at the football stadium not long away, the floor of the club is still empty and one of them looks from the other half in the stands. [SEP] braves rookie matt jeffey, the nl cy young winner, had a. 251 average on five hits in 3 1 - 3 innings [SEP]"} +{"type": "sample", "index": 4, "raw_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 ( upi ) - - \" 30 rock ' s hard rock concert \" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk ' s crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]", "detok_text": "[CLS] abdul hamer, a political journalist and local political analyst. [SEP] 8 (upi) - - \"30 rock's hard rock concert\" bottomed out of the top 10 nominations for the mtv music awards to take no. 1 spot saturday, fox and mtv networks announced thursday. [SEP] the deal is expected to start at £45 a month. [SEP] but he made his point. [SEP] the arctic hawk's crew has been the victim of a legal dispute with a turkish company. [SEP] but ask the doctor and you can choose from just the following - - and then figure out in the best way. [SEP] the inquiry was found [SEP]"} +{"type": "sample", "index": 5, "raw_text": "[CLS] last month, general pervez mushari ' s rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won ' t be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday ' s 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]", "detok_text": "[CLS] last month, general pervez mushari's rule, and the appointment of the saudi foreign minister. [SEP] this is partly because many customers won't be able to cover it. [SEP] after two minutes of the game was halted, the redhawks were running high pressure over five - 10 minutes. [SEP] the market is in decline, and it may get to less than 700 by the end of the year. [SEP] the offense finally made its way into the secondary, keeping quarterback austin feeley in the outfield and running for a second time after saturday's 5 - 1 loss at pittsburgh to the bills. [SEP] it ' [SEP]"} +{"type": "sample", "index": 6, "raw_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]", "detok_text": "[CLS] cities will bring them more reliable supply over the next few years, \" said dave lech, director of the agriculture program at the international center for agricultural research. [SEP] that would not be sufficient to prevent the creation of a private financial sector scheme. [SEP] despite the raf aircraft presence there in afghanistan, there is a shortage. [SEP] but nato says there are few local people in the country and afghans have not taken part in any major conflict. [SEP] accommodation, air, breakfast and meals cost £340 to £78 a night, from £945 a person. [SEP] if you can use saucer, water or electricity, or [SEP]"} +{"type": "sample", "index": 7, "raw_text": "[CLS] using it as a long shot, and a language that many people still don ' t understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]", "detok_text": "[CLS] using it as a long shot, and a language that many people still don't understand. [SEP] a few days when the sun is high and low as they prepare for a strong storm. [SEP] \" i do believe that he has ever received a bank loan. [SEP] it was easy to get a bad deal. [SEP] it was worth up to £60, 500. [SEP] with more than 100 iphone phones, blackberry users can play for their own money or choose their own cards. [SEP] police and witnesses said the man was killed in the car and within minutes later he was travelling in a car in the road near south arne road. [SEP]"} +{"type": "sample", "index": 8, "raw_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain ' s military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \" residual \" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]", "detok_text": "[CLS] the crisis is also likely to be inflation caused by falling fuel prices, falling wholesale food prices, rising lending costs and rising credit and mortgage interest rates. [SEP] the researchers argue that it is most difficult to operate within the jurisdiction of the national security commission and could cause problems under police investigation. [SEP] so are the yellows, the pinks and the grays and pinks. [SEP] britain's military advisers have rejected plans by the government for thousands more troops to be engaged in fighting in afghanistan and called for an extension to the us request for the current \"residual\" taliban presence in afghanistan. [SEP] gordon brown has been given the job [SEP]"} +{"type": "sample", "index": 9, "raw_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \" maybe, of course, \" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 ( upi ) - - canadian police officials searching for a man who was once known as \" the prince \" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]", "detok_text": "[CLS] that the added treatment may have included enviable conditions but no injuries. [SEP] \"maybe, of course,\" six months back it was. [SEP] sixteen of the top 20 officers and five officers were women, later killed by the authorities, according to the intelligence official. [SEP] 4 (upi) - - canadian police officials searching for a man who was once known as \"the prince\" was convicted in montreal for killing a teenager nine years ago. [SEP] a police spokesman said it could not confirm the exact location or language. [SEP] in the big tent, tents and a tent which provides people with a minimum of food and water - [SEP]"} +{"type": "sample", "index": 10, "raw_text": "[CLS] the new deal, and mr abbas ' s absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan ' s short song, followed by a reunion, his third book series of the same kind, sold $ 1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]", "detok_text": "[CLS] the new deal, and mr abbas's absence could undermine the negotiations. [SEP] in just one week, the musical adaptation of david vaughan's short song, followed by a reunion, his third book series of the same kind, sold $1. 7 million copies. [SEP] he was only 10 days old, when he was put in a mental psychiatric hospital, and died in his sleep. [SEP] customers are invited to receive a e - mail message or call their office at 800 - 865 - 4670. [SEP] he said his wife killed him in her home. [SEP] the result, if the election is decided to be decided by [SEP]"} +{"type": "sample", "index": 11, "raw_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan ' s president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]", "detok_text": "[CLS] unveils its trading results on tuesday, said that its operating profit was £10. 2m in the quarter but that underlying figures were still positive. [SEP] the crash reportedly had happened during an engineering flight more than two years ago. [SEP] the military chief, gen abdul mohammed guzl, fired army chief, gen benazir bhutto in an emergency decree to declare state of emergency, which suspended rule of pakistan's president and could trigger new challenges to the constitution. [SEP] as the first sounds, we can be woken at least three times by air in the vault. [SEP] they cut off our electricity. [SEP] but it [SEP]"} +{"type": "sample", "index": 12, "raw_text": "[CLS], chip chip makers intel corp corp ( brc. n : quote, profile, research, buzz ) and hewlett - packard co ( hpc. n : quote, profile, research ). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland ' s first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]", "detok_text": "[CLS], chip chip makers intel corp corp (brc. n: quote, profile, research, buzz) and hewlett - packard co (hpc. n: quote, profile, research). [SEP] israel has conducted the initial assessment of the syrian nuclear program since october 2008, though its leaders have not changed their position. [SEP] the second raid in hewlett took place early sunday morning for security reasons. [SEP] four lawyers have also been arrested over the murder of poland's first president, lechmovitsyn. [SEP] \" the difference between their interest rates and your charge - credit level in the next period will [SEP]"} +{"type": "sample", "index": 13, "raw_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he ' s still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank ' s chief executive, has already told mps that \" if in [SEP]", "detok_text": "[CLS], many of its staff stand to lose their jobs. [SEP] but he's still 30, now only 18 months old. [SEP] mr hewer claimed in court that he had gathered a series of evidence. [SEP] more than 5, 000 teenage boys from south africa were found dead as part of the fighting over the doors of an saabur school in drab al - houthi province. [SEP] they also sought the help of investigating the cause of an accidental death and whether it was thought it could be murder. [SEP] however, jonathan dundowns, the bank's chief executive, has already told mps that \" if in [SEP]"} +{"type": "sample", "index": 14, "raw_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you ' ll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \" it ' s normal and i ' m just waiting to be found convinced that it works, \" says dr [SEP]", "detok_text": "[CLS] a year ago in august, while sales of net production for the year of 2008 was £2. 6 million. [SEP] the search helicopter trained by the u. s. navy took off at about 5 p. m. but it was put on an early chase. [SEP] and you'll even try to register with your telephone number and address later in the day. [SEP] it was only four minutes for the chinese team, before the all - american was settled and the final place in the final was taken into a hands. [SEP] \"it's normal and i'm just waiting to be found convinced that it works,\" says dr [SEP]"} +{"type": "sample", "index": 15, "raw_text": "[CLS]ic body in the world food energy agency. [SEP] \" you ' re lucky and may get a few weeks, \" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf ' s recent appointment of three judges, the former head state, four days after he was declared minister in pakistan ' s defense ministry. [SEP] a judge at the us university of southern california [SEP]", "detok_text": "[CLS]ic body in the world food energy agency. [SEP] \"you're lucky and may get a few weeks,\" said barbara brown, a senior professor of premedic medicine at the university of washington who recently became the first permanent w. e. c. director of the national center of family and health policy. [SEP] in march khan, who also was cleared, admitted that he had found a number of documents relating to gen musharraf's recent appointment of three judges, the former head state, four days after he was declared minister in pakistan's defense ministry. [SEP] a judge at the us university of southern california [SEP]"} +{"type": "sample", "index": 16, "raw_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it ' s easy to imagine you ' ll be playing the phone for a long time and, in fact, it has [SEP]", "detok_text": "[CLS] more of any kind of law than the legal system. [SEP] during the downturn, there were complaints that led him to slow with his mind. [SEP] the inquest in barwell crown began on 11 march, one day. [SEP] but mr. johnson criticized the current practice of using the internet to get in patients to enroll in the program. [SEP] it follows a video report of incidents in which three children sat in a car near their care home while they were driving in high conditions while others driving in public. [SEP] it's easy to imagine you'll be playing the phone for a long time and, in fact, it has [SEP]"} +{"type": "sample", "index": 17, "raw_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we ' ve never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince ' s father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington ( ap ) - the treasury is [SEP]", "detok_text": "[CLS] u. s. military forces serving overseas have dropped 50 percent in afghanistan, according to a new report released on wednesday. [SEP] we've never stopped talking. [SEP] the oil company took over the case in 2003, is overseen by the state supreme court of california. [SEP] a former linebacker, prince's father, was kicked out of the game in 2005. [SEP] the agency said prices remained down in supermarkets and beer and dry goods were banned from other stores and even in supermarkets. [SEP] i had to go this way back in 30s, or maybe, to phone calls and texts. [SEP] washington (ap) - the treasury is [SEP]"} +{"type": "sample", "index": 18, "raw_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]", "detok_text": "[CLS], i was at school, aged only three or four. [SEP] but i fought back. [SEP] if you have a mistake, help look in the right way as well as the very opposite. [SEP] the military criminal investigation office and the u. s. department of defense released a copy of the report they released saturday morning. [SEP] linas khaled also added 14 points and tony richardson made 16 for the clippers, their most of the season. [SEP] he stepped down in december after 15 months as the head of an opposition party in a corruption scandal. [SEP] but we see that this tells a different story. [SEP] the decision made [SEP]"} +{"type": "sample", "index": 19, "raw_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \" no evidence whatsoever that it was made public. \" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc ' s new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]", "detok_text": "[CLS] fruit and ambiete. [SEP] the commissioner has ordered mps to publish the details of the claims, saying there is \"no evidence whatsoever that it was made public.\" [SEP] countryman david jones made his first double birdie in the last three holes to move into the lead with just one - over - all. [SEP] their bosses came to challenge the nature of the bbc's new three crime shows, radio 4 and breakfast. [SEP] when hundreds of the pupils were jailed for their use of cell phone equipment to sit on paper, they announced that they had refused a place at the school. [SEP] but in washington, it has also [SEP]"} +{"type": "sample", "index": 20, "raw_text": "[CLS] world freedom. \" [SEP] it ' s one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]", "detok_text": "[CLS] world freedom. \" [SEP] it's one way to help you. [SEP] the former chairman was seen to spend time he needed in so that the people would respect his decisions. [SEP] yet some higher - level scientists are still arguing that the speed of light could enrich the theory of human life, say researchers. [SEP] this country has long been operating under the bush administration as it oversaw the election of many ministers, including human rights figures, personnel, politicians and other civil servants. [SEP] the lawyers for mr connelly, ms mccrabb, 47, and mr mcnicol, all of glasgow, have been put on hold for [SEP]"} +{"type": "sample", "index": 21, "raw_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street ' s regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can ' t make much of a huge difference at all. [SEP] it ' s about 300 people. [SEP] the hospital built at st james ' s [SEP]", "detok_text": "[CLS] falklands war. [SEP] lord goodwood, who was a great fan of george smith street's regime and a former figure in the home office, decided to open the inquiry with a speech on the issue on saturday. [SEP] factoring with high debt levels can take them to - - - and therefore achieve - - a savings of £1 million a year. [SEP] but after a week in mississippi, the couple were comfortable, returning to their hotel, staying out of the cold. [SEP] it can't make much of a huge difference at all. [SEP] it's about 300 people. [SEP] the hospital built at st james's [SEP]"} +{"type": "sample", "index": 22, "raw_text": "[CLS] be able to bring the driver into custody, \" said robert o ' brien, a spokesman for the u. s. immigration and customs enforcement administration ' s office. [SEP] the installation would have cost about $ 35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]", "detok_text": "[CLS] be able to bring the driver into custody, \" said robert o' brien, a spokesman for the u. s. immigration and customs enforcement administration's office. [SEP] the installation would have cost about $35, 000. [SEP] the federal criminal court had ruled the judge had imposed the sentence after serving a year of his sentence and the charges can be carried only hours after a provisional release date is issued later in the year. [SEP] however, the figure could now rise to £47m from £5m last year - almost £62m. [SEP] this film will be performed at a live stage at a hollywood studio in los angeles [SEP]"} +{"type": "sample", "index": 23, "raw_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford ' s top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]", "detok_text": "[CLS]. 3 billion dollars. [SEP] ford had hoped for one of ford's top sales, but sales of the car, which included the fiesta focus and its popular sibling, were nearly double to june last year at a loss of 9 percent. [SEP] the vehicles sold in november 2009 and went on sale in december 2009. [SEP] in november 2000, ryan, who spent nine months there and was running for state senate post, became a new director of information and created an executive committee to make leon w. acker, its director, a republican nominee for the job. [SEP] the preliminary results in a separate study issue of the journal nature human [SEP]"} +{"type": "sample", "index": 24, "raw_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \" live in six months, \" it would be seen as the radical change of how we can all live because palin doesn ' t name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]", "detok_text": "[CLS] williams, clinching its second title. [SEP] research shows that 1, 000 short - term mortgage customers have been refinanced to repay their loans at high interest rates. [SEP] during the depths of the global financial crisis however, the funds have called for the firm to go bust. [SEP] although the night was \"live in six months,\" it would be seen as the radical change of how we can all live because palin doesn't name it. [SEP] an american. [SEP] the european nations are also drawing up a report for an anti - corruption group expected to report on their response to the crisis, the focus of an [SEP]"} +{"type": "sample", "index": 25, "raw_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]", "detok_text": "[CLS] the need for peace. [SEP] that campaign has triggered even more criticism, with the bank ordering it to suspend its bonus compensation scheme in march. [SEP] the plans were to be abandoned. [SEP] louisville has made the run in the a - tournament championship for four consecutive seasons, reaching a national championship round against the hilltoppers on june 4. [SEP] for a week, she had no need to drop the head arm near the chest, while holding a checkup on a fetal arm. [SEP] it was also a piece of what is now a property that has been sold to the new york legal arts museum in new york city. [SEP] the president was [SEP]"} +{"type": "sample", "index": 26, "raw_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] ( ap ) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]", "detok_text": "[CLS] to its shareholders and those paid for by government bailouts, its banks could face further losses. [SEP] the company said that this model will start selling in early 2009, so he will still have to get an update for the new 2010 model over the coming months. [SEP] (ap) - authorities have begun hunting for an internet user who created an online pornography web service that sold video videos of each other online, authorities said tuesday in a court battle to be dismissed. [SEP] he was shot dead on july 25 and is later dead at a u. s. air base in southern afghanistan. [SEP] shares fell about 32 percent, or 7. [SEP]"} +{"type": "sample", "index": 27, "raw_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane ' s family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \" i heard that the police were called to the house of the family home and the answer was \" no i ' ll be away. \" [SEP] it ' s not easy to be seen, even though you ' re not sitting in the king ' s bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]", "detok_text": "[CLS]b said. [SEP] i read them, not like a big deal. [SEP] mr mcfarlane's family appealed against those claims made in court and rejected the charges that were lodged against him. [SEP] \"i heard that the police were called to the house of the family home and the answer was\" no i'll be away. \" [SEP] it's not easy to be seen, even though you're not sitting in the king's bedroom. [SEP] but in an unusual move, the governor was joined thursday by the bank chief and the head of the financial services authority when he appeared on a live session of its meeting. [SEP]"} +{"type": "sample", "index": 28, "raw_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york ( ap ) - glaxo co., the second - largest drug after merck, is investing about $ 500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa ' s parliament will be close by the end of the year. [SEP] everything was clear, it didn ' t seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]", "detok_text": "[CLS] financial market trouble, \" chairman alan greenspan wrote. [SEP] he rarely won it all in every tournament as he did on sunday. [SEP] new york (ap) - glaxo co., the second - largest drug after merck, is investing about $500 million of cash to try to sell about 20 percent of the drugs, meet regulatory and administration costs and improve its costs. [SEP] south africa's parliament will be close by the end of the year. [SEP] everything was clear, it didn't seem like everyone was talking to us. [SEP] he was taken by the director of the national security service, who said [SEP]"} +{"type": "sample", "index": 29, "raw_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn ' t work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe ' s biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn ' t want to be seen just to bring up his wife and leave him [SEP]", "detok_text": "[CLS] was worth between £4200 and £550 a night, for £3. 16. [SEP] chamberlain and floyd didn't work, going fast and allowing three hits and three innings of the night for a 6 - 4 win in a pair of starts. [SEP] sanofi, which has been europe's biggest trading partner since 2001, is likely to set a firm date for the takeover bid, the ft said. [SEP] federal prosecutors granted u. s. district court judge robert w. ailock the first five months of his sentence thursday. [SEP] he doesn't want to be seen just to bring up his wife and leave him [SEP]"} +{"type": "sample", "index": 30, "raw_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister ' s plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party ' s administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban ' s goal of staging attacks, afghanistan is a key target of military support and support in tuesday ' s presidential election, given the organization ' s position that \" fighting [SEP]", "detok_text": "[CLS] an open inquiry. [SEP] mps have backed the prime minister's plans to make sure the expenses investigation is cleared ahead after the expected review of the case, the party's administration, the governing body and the parliamentary civil service authority, are investigating the expenses claims of thousands of independent lawyers. [SEP] this year about 7. 5 million people were employed in the £15 million mobile phone market in 2007. [SEP] considering whether u. s. involvement in afghanistan matches the taliban's goal of staging attacks, afghanistan is a key target of military support and support in tuesday's presidential election, given the organization's position that \" fighting [SEP]"} +{"type": "sample", "index": 31, "raw_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father ' s place, a car followed him down the road and bell, 40, died just hours after the attack on the men ' s room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]", "detok_text": "[CLS] aclu and japanese pop singer yoshi inao, who will perform live. [SEP] blood pressure? [SEP] in his father's place, a car followed him down the road and bell, 40, died just hours after the attack on the men's room. [SEP] he had used his old phone, threw himself and locked himself in in a basement. [SEP] commander of the nato - afghan forces gen. david petraeus and gen. david morrell also said the force remains in danger. [SEP] federal officials announced the arrest wednesday of fazbullah for involvement in the killing and subsequent assault of two taliban commanders, the chief of [SEP]"} +{"type": "sample", "index": 32, "raw_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \" you do know what to make of a data camera \" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i ' d leave home soon [SEP]", "detok_text": "[CLS] end of this year. [SEP] he also took administrative leave while in high school until his short - term appointment at the end last month. [SEP] now, \"you do know what to make of a data camera\" - - often located in the back of a big camera. [SEP] but he is not allowed to comment on the details of the case. [SEP] in mid - october, toyota said it was cutting 600 jobs over the next seven months, while almost 1, 000 new trainees would lose their jobs over a three - year period. [SEP] \" he has really been around for a good long time so i'd leave home soon [SEP]"} +{"type": "sample", "index": 33, "raw_text": "[CLS], and more than $ 2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $ 500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]", "detok_text": "[CLS], and more than $2 billion of shares from commerzbank co., corp. co. and chrysler inc., is expected to raise as much as $500 million. [SEP] bmw and toyota motor inc. said monday that they would not ramp up sales to match the loss of cash after a decline in auto sales. [SEP] virginia also had a couple of 15 points to pull a few games. [SEP] it was an essential task, including the car and job, but their friendship was dependent on her musical success. [SEP] a challenge to the final status of the credit agreement was issued on august 3, the same day the administrator [SEP]"} +{"type": "sample", "index": 34, "raw_text": "[CLS] evra, anelka and petr mikel on target but manchester united ' s james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday ' s last game of the six nations championship. [SEP] most of the company ' s board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]", "detok_text": "[CLS] evra, anelka and petr mikel on target but manchester united's james milner had to get his best save from david beckham. [SEP] the premier league club hit the ground after winning only four of the premier league matches in the season with no sign of faith in their prospects. [SEP] andy macleod will probably miss the rest of the rugby regime for saturday's last game of the six nations championship. [SEP] most of the company's board had urged aid in reaching a package that could push the company into bankruptcy. [SEP] a u. a. a. case took place here outside the country in 2007, [SEP]"} +{"type": "sample", "index": 35, "raw_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california ( ap ) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders ' group recommended the company not to close the deal. [SEP] \" the election that was not credible appears to be conducted by security authorities, \" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]", "detok_text": "[CLS]. [SEP] we do not need to jump to the road, we only sit in the middle of the trees that run down the road, for us to rebuke. [SEP] santa rosa, california (ap) - - jeff karp grinned and waved at the new dodger at daytona beach on wednesday night. [SEP] in a recent interview with the times, a shareholders' group recommended the company not to close the deal. [SEP] \"the election that was not credible appears to be conducted by security authorities,\" said state state department spokesman alastair gordon. [SEP] expect to see a school closing in the afternoon, when the school begins [SEP]"} +{"type": "sample", "index": 36, "raw_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]", "detok_text": "[CLS] from the family. [SEP] in the ft the index lost 0. 8 per cent. [SEP] there should be no more of this nonsense. [SEP] also saturday, omar al - mutli met with the iraqi prime minister, murr al - assad, who had urged the first formation of a government after the results of the june 12 presidential election, in which president hussein al sadr, and the vice president, sheikh zine al - sadr, each won three posts and 10 seats respectively. [SEP] for many years, he began his career as an engineering engineer and later took a course of music lecturers at the university [SEP]"} +{"type": "sample", "index": 37, "raw_text": "[CLS] president pervez musharraf, who ousted mu musharraf ' s government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it ' s believed that the younger brothers had carried out the attack but this was the work of the children ' s father and mother. [SEP] england ' s gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]", "detok_text": "[CLS] president pervez musharraf, who ousted mu musharraf's government. [SEP] this has so many negative implications that it is irrelevant. [SEP] 4. at which inflation stands at 5. 1 % annually. [SEP] it's believed that the younger brothers had carried out the attack but this was the work of the children's father and mother. [SEP] england's gold cup rowers last won a championship game back in 1981. [SEP] currently president mugabe is not allowed to participate in a state assembly which answers a series of questions, whether in public about whether his rivals should seek powers for him. [SEP] no [SEP]"} +{"type": "sample", "index": 38, "raw_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that ' s when the gao ' s progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]", "detok_text": "[CLS] its supply of news, to deep inside its offices, there is little to make the job seem pointless. [SEP] the us government has previously acknowledged there had been lack of control and monitoring of the situation. [SEP] he said he was now calling for bank of america to have non - fed government interest rates cut by a further quarter point. [SEP] between july 1 and dec. [SEP] and that's when the gao's progress report is being issued this week. [SEP] in addition their assertions have been condemned as the major failures of the national security act. [SEP] indeed, the technology becomes the same, and you can never assume that you [SEP]"} +{"type": "sample", "index": 39, "raw_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia ' s supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]", "detok_text": "[CLS] the modern sense of humour. [SEP] the spanish flu virus caused more than 600, 000 deaths in just 20 % of cases, and is affecting its spread in the world, a senior state department spokesman said. [SEP] the president of russia's supreme court will make a later hearing. [SEP] hundreds of thousands of foreign security personnel have lost their jobs, sheltering by western forces in hundreds of high - profile attacks in afghanistan. [SEP] authorities said the three people have been charged of murder, and a formal announcement has been made about her bail. [SEP] the father of the u. s. president, who was a hero of the gold medal [SEP]"} +{"type": "sample", "index": 40, "raw_text": "[CLS] 0. 0308 swiss francs ( 0. 0301 ; 1. 0599 ). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england ' s european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]", "detok_text": "[CLS] 0. 0308 swiss francs (0. 0301; 1. 0599). [SEP] it said it is investigating reports that it has seen an interest rate increase on its customers between 2007 and 2008. [SEP] now the total cost is over £2, 500. [SEP] the striker made his fourth award of african footballer of the year and thus won a prize. [SEP] haughton has denied, however, that his client is in any association with england's european championship football team, and he said he would consider a final offer for portsmouth within 30 days of arriving. [SEP] it expects to be ready in just a few months [SEP]"} +{"type": "sample", "index": 41, "raw_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl ' s house. [SEP] salary range from £3, 884 - £36, 188 ; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]", "detok_text": "[CLS] three counts of murder and one of burglary fraud. [SEP] she has also promised to review debates on radio and television programmes, but has also refused to address her concerns about the debates. [SEP] they found a video phone camera right where the girl was found, a call from the woman to dial a 911 call quotation and phone calls in the girl's house. [SEP] salary range from £3, 884 - £36, 188; £33, 713 - £31, 575. enforcement jobs. [SEP] many men have a letter of apology, with some personal information about a variety of crimes. [SEP] the owner of [SEP]"} +{"type": "sample", "index": 42, "raw_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $ 24. 7 billion worldwide. [SEP] that ' s when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \" he was here for america to come, \" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]", "detok_text": "[CLS] a non - government program set up in congress akin to a national education agency. [SEP] quarterly sales fell 5. 3 %, to $24. 7 billion worldwide. [SEP] that's when voters were being encouraged to have the most important changes in their lives. [SEP] the type of antibody was detected in federal trials several years ago to find evidence that the drug could prevent breast cancer. [SEP] \"he was here for america to come,\" obama said at a recent news conference. [SEP] the golds came from a career as a director and returned to work as a director for the irish philharmonic. [SEP] at present, the obama administration has [SEP]"} +{"type": "sample", "index": 43, "raw_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $ 20 a month for the year. [SEP] o2 : virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]", "detok_text": "[CLS] in the house. [SEP] in another, she ran in her blue - colored small car, fell with a tree and had to lie in the air. [SEP] kuzschko also was last in the hamburg final this year when he hit the world stage, and murray is the only croatian man to move into the top two spot. [SEP] at a typical rate, residential rates start at only $20 a month for the year. [SEP] o2: virgin customers will spend 70 per cent of their money, on their own computer and tv service, on the digital and digital or digital services such as satellite tv. [SEP] authorities have said the [SEP]"} +{"type": "sample", "index": 44, "raw_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland ' s own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said : \" it ' s not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]", "detok_text": "[CLS] september. [SEP] anderson pulled back glen johnson only two seconds into extra - time but benn phillips nodded in the rebound after taking the penalty box shortly before the interval, after scoring from jason scotland's own corner. [SEP] bmw has made strong demand from far emerging markets. [SEP] tuc general secretary colin mcgowan said: \" it's not like there are about 10 people made redundant at the time of reference. [SEP] the 2008 season may have long been under way, but at least it also saw a winner on the final stage of the nomination campaign. [SEP] under a five - year deal in which the club will receive a [SEP]"} +{"type": "sample", "index": 45, "raw_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos ( d - calif. ) said thursday she was pushing for progress on what she has described as a \" routine case \" [SEP]", "detok_text": "[CLS] pet store in billington road, stevenage, shortly afterwards on 11 july 2007. [SEP] it was not widely acknowledged that she took over the state - made post in 1994. [SEP] under that agreement with the government, mr ashcroft was suspended and would continue his work as a gp or a schoolteacher in the island. [SEP] i hope this goes to him. [SEP] all three female athletes played, danced, danced and helped each with their own musical decisions. [SEP] u. s. rep. tom lantos (d - calif.) said thursday she was pushing for progress on what she has described as a \"routine case\" [SEP]"} +{"type": "sample", "index": 46, "raw_text": "[CLS] to women, and he was highly critical of the episcopal church ' s approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \" russia ' s internal law, \" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]", "detok_text": "[CLS] to women, and he was highly critical of the episcopal church's approach and policy. [SEP] putin, who wrote to the president and chairman of a probe called \"russia's internal law,\" previously published by gen musharraf, said russia was not asked to take action out because its economic laws were lax. [SEP] kaur, who is a us military judge, said he would appeal his sentence in exchange for his release. [SEP] robert tancock, aged 18, was found on top of the bus in northgate beach about 10 days after taking refuge in a community fitness centre in brindall, hampshire on 26 [SEP]"} +{"type": "sample", "index": 47, "raw_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \" if the evidence is compelling we will conclude that all of this evidence is a criminal crime, \" the statement said. [SEP] \" their joint function is not good, \" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]", "detok_text": "[CLS] say the building is likely to take several months to complete. [SEP] i was also surprised to report that the army has no track record of soldiers in iraq. [SEP] the application is also being available to the public, schools and sport groups. [SEP] \"if the evidence is compelling we will conclude that all of this evidence is a criminal crime,\" the statement said. [SEP] \"their joint function is not good,\" said dr. william tatt, the emory university professor of medicine, who is involved in studying human health at the emory university of atlanta school of medicine. [SEP] the cia documents provided no proof that the terrorist threat is imminent [SEP]"} +{"type": "sample", "index": 48, "raw_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp ' s online \" world ' s e - band \" or amazon ' s ( ook ), owned by online retailer amazon. com ( kos. n ). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]", "detok_text": "[CLS]. [SEP] china has no tigers in a few years, and many dolphins have died in recent years. [SEP] gas prices are up 8 % this week as record gas demand and petrol prices could also fall further. [SEP] amazon. com hands the company into the next generation of sony corp's online \"world's e - band\" or amazon's (ook), owned by online retailer amazon. com (kos. n). [SEP] but the new management and legal rules remain vague, too, and will continue to match that policy. [SEP] happy to hear for sure. [SEP] it also dropped out of poverty. [SEP] [SEP]"} +{"type": "sample", "index": 49, "raw_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn ' t know - - and he said he wouldn ' t know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]", "detok_text": "[CLS] found the high school in a state court, which concluded was the victim of a violation of the high school rules that had refused to report state data. [SEP] mr prows and his sister, a teenage boy from cheltenham, died in a tragic incident, as she left school for a holiday in denbighn. [SEP] he did say he didn't know - - and he said he wouldn't know the identities of the employees. [SEP] so it was as if i saw a friend while someone was behind me that evening during a new look. [SEP] in a statement, the bank announced a number of 1, 300 new jobs [SEP]"} +{"type": "sample", "index": 50, "raw_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran ' s state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami ' s office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany ' s russian president, vladimir putin, has refused to back a new un ban on israel ' s nuclear weapons [SEP]", "detok_text": "[CLS] involved making sure they had no time to trade cars. \" [SEP] the two men were in the flat where the men were while the children were leaving when neighbours said their car was gone for help. [SEP] iran's state television said that authorities have begun an investigation to determine the cause of the blast, which was close to khatami's office last sunday. [SEP] the officer had put her son in the water only to stay on with his own daughter when she was potholed on a nearby field. [SEP] germany's russian president, vladimir putin, has refused to back a new un ban on israel's nuclear weapons [SEP]"} +{"type": "sample", "index": 51, "raw_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \" unspecified amount of time \" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]", "detok_text": "[CLS] 2004, attempts to serve in the high court without facing charges, even though he is charged with being a judge for an \"unspecified amount of time\" during the upcoming election. [SEP] \" he is one of the people who once said they would die at the wheel of a car. [SEP] the tiger that was placed in a state of the tiger was killed, the police said. [SEP] the british forces have hoped for a new command order for al qaida. [SEP] it is still under way. [SEP] the suspect was extradited by the fbi, but authorities were trying to gather evidence in the case, police said. [SEP] the [SEP]"} +{"type": "sample", "index": 52, "raw_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]", "detok_text": "[CLS] at the time of the previous attack, the washington post reported wednesday. [SEP] the end of the current six - month programme, which was suspended until the end of fiscal year 2010, was extended until march next year and continued into march next year. [SEP] a new generation of israeli high - definition tv - room equipment and high - powered equipment has been set to record a live performance in a live online show on the web site on wednesday. [SEP] he said it will be known if any information is available on april 27, but nottinghamshire police, which said officers were expected to review the situation, appealed for information. [SEP] the report also found [SEP]"} +{"type": "sample", "index": 53, "raw_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]", "detok_text": "[CLS] into the final available opportunity in 65th minute. [SEP] occasionally, he has to run to the point that that is far out of the law. [SEP] he also said that shareholders were disappointed. [SEP] since then, the sides have failed to discuss an agreement but the afghan government in recent weeks has been able to secure a compromise agreement on the request of the federal and afghan authorities. [SEP] but the financial crisis has made it a risk of widespread social unrest. [SEP] the embassy has asked the u. s. embassy and american foreign office personnel to train their foreign - assistance staff for the missions. [SEP] according to government statistics, the number of [SEP]"} +{"type": "sample", "index": 54, "raw_text": "[CLS] 3m last year, made a net profit of £9m to $ 2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions ' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $ 11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]", "detok_text": "[CLS] 3m last year, made a net profit of £9m to $2, 95bn. [SEP] when he was replaced by hodgson, the team coach defended his decision to keep his place on the lions' front line and management during a first - team news conference last month. [SEP] he is expected to be released on tuesday. [SEP] 2007 march - a presidential election is postponed. [SEP] a third person was shot dead a mexican army officer a month and an american national. [SEP] cit, which has bought more than $11 billion assets, has since filed documents with the federal reserve and u. s. treasury seeking to sell it [SEP]"} +{"type": "sample", "index": 55, "raw_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime ' s elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday : \" we have a number of differences between the us and the [SEP]", "detok_text": "[CLS]is and displacty. [SEP] in fact, the judge has not released any plans to an indictment, and if he continues his attorney could be in court for more evidence to be available. [SEP] he was locked in a fully locked bed where his father was sleeping. [SEP] it has been a very short period of time. [SEP] but cowboys coach bob sanders says he could not simply play the game. [SEP] as a member of the nuclear - power regime's elite there is unease under the current president, vice president robert kagame of rwanda, who said tuesday: \" we have a number of differences between the us and the [SEP]"} +{"type": "sample", "index": 56, "raw_text": "[CLS] british personnel arriving in afghanistan are expected to add a \" big challenge \" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 ( 1, 626 ), with birmingham starting at £14, 200 ( 1, 200 ), london derby starting at £21, 200, london starting at £26, 827 ( currently £6, 200 ) and london at £345, [SEP]", "detok_text": "[CLS] british personnel arriving in afghanistan are expected to add a \"big challenge\" among 30, 000 afghan troops to the number of army combat troops and joint command staff, and force commanders to put a head in the bag of soldiers in case they were forced into an open fire battle. [SEP] the school, almost 1, 200 years since they opened in 2005, starts at £2, 000 (1, 626), with birmingham starting at £14, 200 (1, 200), london derby starting at £21, 200, london starting at £26, 827 (currently £6, 200) and london at £345, [SEP]"} +{"type": "sample", "index": 57, "raw_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \" there were no preclinious remarks at him, he was never found to accept that position, \" the judge said. [SEP] \" all of it ' s floating around the [SEP]", "detok_text": "[CLS] surrendered to authorities in the past 10 months. [SEP] but now it is understood that mr obama has come to his defence after speaking out about the case in which mr megrahi was arrested in february and charged with crimes against humanity. [SEP] u. s. three soldiers were killed in the attack in the southern part of helmand province. [SEP] since the number one aged 65 and only 25 they lose 1. 5 per cent on the average day. [SEP] \"there were no preclinious remarks at him, he was never found to accept that position,\" the judge said. [SEP] \" all of it's floating around the [SEP]"} +{"type": "sample", "index": 58, "raw_text": "[CLS] it ' s difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \" short of the full protocol \" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]", "detok_text": "[CLS] it's difficult to have it be approved by the legislature created by the next president. [SEP] the problems happened sunday while the home office urged police to make changes to the work hours and cut the number of calls from officers. [SEP] in contrast, the dollar is now higher with short - term earnings in europe and asia, thanks to stronger exchange rates. [SEP] both men were sentenced to life in prison awaiting trial. [SEP] the european court of justice is also expected to argue its recent review of the law in the \"short of the full protocol\" that it can review. [SEP] the commission will review a review of trucking regulations since the [SEP]"} +{"type": "sample", "index": 59, "raw_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4 ' s gardener ' s kitchen programme and found alan johnson and stephen brown in the stockmarket ' s training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]", "detok_text": "[CLS] most of those things are going down quickly. [SEP] finally, at 7, he appeared in bbc radio 4's gardener's kitchen programme and found alan johnson and stephen brown in the stockmarket's training ground, ready to feel the heat this time. [SEP] another argued that abdullah resigned one week ago because authorities would simply not have the power to appoint a leader that would oversee the official selection process to run for a second term. [SEP] there were charges - - and possibly concerns - - that he was arrested after his comments, failed to take a formal disciplinary order, and then was arrested for two other offenses. [SEP] \" this [SEP]"} +{"type": "sample", "index": 60, "raw_text": "[CLS] the field. [SEP] los angeles ( ap ) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]", "detok_text": "[CLS] the field. [SEP] los angeles (ap) - secretary robert gates and former bush vice chairman alberto r. gonzales were named the top u. s. attorney general wednesday. [SEP] the two were held at u. s. army facilities 60 miles south - southeast of the city of leavenworth, military officer and military officials said. [SEP] they said three taliban fighters had been killed in the attack, apparently on their own, and a statement said a policeman was killed when insurgents hit a police officer in the area. [SEP] susan sanchez, a nurse from orange county, calif., said the orange county public health officials had issued an [SEP]"} +{"type": "sample", "index": 61, "raw_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain ' s second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country ' s vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]", "detok_text": "[CLS] with a six - fold increase in july. [SEP] bp, britain's second largest oil company, is to field three of the top executives, with a majority stake by the end of the year, to pursue oli elahi, the country's vice - president, over his concern over the prospects of a peace deal. [SEP] an public inquiry was held in june, after it was launched. [SEP] a couple wrongly claimed on the civil service pension benefit policy was given legal advice at the high court after hearing evidence that a solicitor did not know how to claim compensation for the highest rate that costs below £1, 500. [SEP] [SEP]"} +{"type": "sample", "index": 62, "raw_text": "[CLS] as \" offensive and common sense. \" [SEP] \" the good morning news \" john gibson ( r - i - lieberman ) are in town during the news conference, and they keep doing that, abc ' s \" daily news \" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]", "detok_text": "[CLS] as \"offensive and common sense.\" [SEP] \"the good morning news\" john gibson (r - i - lieberman) are in town during the news conference, and they keep doing that, abc's \"daily news\" saturday morning reports. [SEP] the satellite is one of the biggest and most successful warfare centers in the world, including american military operations. [SEP] jones finished the night with six starts, an a. 221 national average and a career all - time best 3. 68 era in 549 games at the club. [SEP] he said he could have found evidence that she had stomach ailments, but it can cause [SEP]"} +{"type": "sample", "index": 63, "raw_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $ 100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn ' t include a specific provision - - it doesn ' t [SEP]", "detok_text": "[CLS] recession before ending them. [SEP] five days after its launch, the program benefits, and each of those earning a $100 - plus hour is paid out of pocket by the service or social security department. [SEP] but if the central government decides to further nationalise sports soon, local authorities will also be re - instituting schedules for the winter games. [SEP] mr wilson and two friends and his sister called the school after they found him sleeping in their bedroom and forced him off the floor when the family found him asleep on their bed and broke into their bedroom. [SEP] the bill doesn't include a specific provision - - it doesn't [SEP]"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260518/lta_owt_t5_3l_d256_rollin_p50_randk0_3_logituniform_subset100_600_save100_20260518_144840/decode_step100_dirichlet_resample_c512_flow_state_t1p4_s128_n64.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260518/lta_owt_t5_3l_d256_rollin_p50_randk0_3_logituniform_subset100_600_save100_20260518_144840/decode_step100_dirichlet_resample_c512_flow_state_t1p4_s128_n64.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..8da2a93ac2f63992329651b865d31c2ec19faded --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260518/lta_owt_t5_3l_d256_rollin_p50_randk0_3_logituniform_subset100_600_save100_20260518_144840/decode_step100_dirichlet_resample_c512_flow_state_t1p4_s128_n64.jsonl @@ -0,0 +1,5 @@ +{"type": "decode_done", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "step": 100, "n_samples": 64} +{"type": "summary", "checkpoint": "runs/lta_owt_t5_3l_d256_rollin_p50_randk0_3_logituniform_subset100_600_save100_20260518_144840/step_0000100.pt", "step": 100, "decode": {"steps": 128, "model_t_mode": "flow", "decode_rule": "dirichlet_resample", "support_power": 1.0, "semantic_power": 1.0, "anchor_mode": "onehot", "cfg_scale": 0.0, "cfg_power": 1.0, "cfg_start": 0.0, "cfg_prior": "uniform", "decode_freq_penalty_alpha": 0.0, "decode_freq_penalty_beta": 0.0, "decode_freq_penalty_floor": 0.0, "decode_freq_penalty_start": 0.0, "decode_freq_penalty_end": 1.0, "decode_freq_penalty_power": 1.0, "start_t": 0.0, "start_init": "noise", "noise_init": "dirichlet", "noise_sigma": -1.0, "dirichlet_concentration": 1.0, "concentration_min": 1.0, "concentration_max": 512.0, "target_prob": 1.0, "endpoint_temp": 1.4, "final_from": "state", "final_sample_mode": "argmax", "final_sample_temp": 1.0, "final_top_k": 64, "final_top_p": 0.95, "final_freq_penalty_alpha": 0.0, "final_freq_penalty_beta": 0.0, "final_freq_penalty_floor": 0.0, "lock_bos": false, "n_samples": 64, "seed": 20260503}, "raw_genppl": {"ppl": 230.50020988757478, "nll_per_token": 5.44025177301145, "tokens": 16320, "kept_samples": 64, "total_samples": 64, "empty_rate": 0.0, "skipped_samples": 0}, "stripped_genppl": {"ppl": 229.0365716485513, "nll_per_token": 5.433881692325367, "tokens": 16320, "kept_samples": 64, "total_samples": 64, "empty_rate": 0.0, "skipped_samples": 0}, "diversity": {"sample_entropy": 2.7314011767141175, "unique_tokens": 1575, "token_count": 65536, "distinct_1": 0.0240325927734375, "distinct_2": 0.11386546920821114, "top_token_mass": 0.390289306640625}} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 0, "raw_text": "Ghana England playing Uruguay competition playing Argentina Adams Gu Argentina playing Lion Uruguaypre Ghana Uruguay Gu result Uruguay Uruguay Uruguay Adams Uruguay competitionsidedMLS Ghana playing-4 Uruguay vorbe Ghana Uruguay competition Lion Uruguay Argentina tactical Uruguay Argentina Uruguay Uruguay Schwe Ghana Uruguay surely Uruguay Uruguaymain Uruguayrez-17field Argentina ArgentinaachievinggrownLET Uruguay Adamsfield playing competitionfieldfield playingeira Uruguay Uruguay Uruguay deep Argentinafield Uruguayrez deepDef Uruguay playing Uruguay Argentina centrebackrez-4field competition Jews Uruguayfieldfieldfield Uruguay playing midfield Uruguay Uruguay playing Uruguay playing centre surely playing Uruguayfield Uruguay Uruguayjar Uruguay Argentina Uruguay playingfield-4field competition South Uruguay competition Uruguayfield Adams Uruguay competition Argentina competitionfield Mexican playing Uruguay Uruguay UruguayMLS UruguayMLS Uruguay Uruguay Uruguay competition Uruguay Uruguay-4 Ex tactical playing Uruguay Uruguay mid1-0 Uruguay3-2 Gu Uruguay Uruguay Uruguay Uruguay Bull Cup joined Uruguay Uruguayhand Germanfield playing Uruguay Uruguayfieldrez Uruguay Dolphin competition Argentina Uruguay UruguayjarDefafter surely Uruguay Mexico competition Uruguay Argentina Adams playing Uruguay Uruguay AdamsLETbackDefMLS defensivebio Uruguayrez competition competition defensive competition Uruguay Uruguay Uruguay Uruguay Uruguayfield Uruguay onto Uruguay Adams Uruguay Uruguayfield France UruguayDefMLS Uruguay Adams Gufieldrainfield possession Uruguayfield Adamsfield playing Uruguay Uruguay Uruguay Uruguay3-2 Uruguay Uruguay Uruguayfield Uruguay Uruguay playing Uruguay Uruguay centre playing Uruguay Nazi Uruguay ArgentinaMLS Uruguay Alt competition Uruguay Uruguay permanently Ghana Carlos playing-2 Uruguay playing Uruguay Atlas disciplineback playingstefield Uruguay Uruguay Argentina playing Argentina Uruguay playing playingfield fluid Uruguay Adams Uruguay Uruguay Uruguay-4 useful playing Uruguay-18field Uruguay Uruguay3-2 centre Uruguay playing Uruguayemploi Argentina-18 Uruguay Uruguaydir Adams EnglandMLS Uruguayfield3-2 defensivefield Argentina ArgentinaMLS Argentina Uruguay Uruguay Uruguay Uruguayafield Argentina Uruguayfield discipline-4field Uruguayfieldfield Uruguayfield Uruguay Argentinafield Mess competition competition Mull only Adams Uruguay Uruguay Uruguay Uruguay Uruguay Uruguay surely Uruguay surely Uruguay Uruguay playing Lion Uruguay Uruguay Uruguay playing Ghana-17 Adams tacticalfieldste Uruguay Ghana Uruguay Argentina Uruguay Adams Adams Uruguay Carlos’ playing surely Argentina Uruguay-4 Uruguayfield Uruguay Uruguayfield Uruguay playingfield omuluibioste competitionfield Adams Uruguay-4 Uruguay Uruguay Germany playingfield Uruguay Uruguay tactical Uruguay Uruguayfield of Uruguay playingfield-4 surelyfield Uruguay past Uruguayjar Uruguayfield Argentina collaborate route competition Ashley Uruguaycid surely Argentina Uruguay-4field-4 Uruguay Uruguay Argentinafield competition Argentina Argentina Adams Uruguay Argentina Uruguay competitionfield competition Uruguay Gu Uruguay Uruguay Argentina Uruguay Uruguayfield Gonzfield hitting-17 playing Adams Uruguayste Uruguay Uruguay Uruguay KillMLSfieldfield Uruguay mid Uruguay Mexico Uruguay Gu Uruguay Argentina Uruguay Uruguayfield competition Uruguay Adams Uruguayfield playingrez playinglev playing Uruguay Uruguay Argentina Argentina-18 defensivefield playing Adams Uruguayfield Uruguay playing Argentina playingfield Uruguay Uruguay Uruguay Uruguay Uruguay Uruguay Uruguay Argentina Argentinafieldfield Uruguay playingfield Uruguay Uruguaydelegates Adams SchwebackDeffieldDef Uruguayfield Argentinafield playingfield grabbe Uruguaybio Uruguay-18 playing competitionfield competition Argentina Uruguay Uruguay Argentina Uruguay competition competition Uruguay Jews usually Bob playing Uruguay Uruguay Uruguay Gu Cap defensivefield mid China Uruguay Argentina Uruguay Uruguay playingUL Uruguay Argentina Uruguay Lion surelyfield Uruguay Uruguay UruguayMLS Uruguay Uruguay Uruguay retention Gu Uruguayfield playing Uruguayfield surely Mullfield surely playing Argentina Uruguay Uruguay Uruguay Argentina donne Uruguay surely surely Uruguay Uruguay Uruguay Uruguay centre Uruguay competition Uruguay Uruguay Gonz Uruguay Uruguay Argentina Uruguay Uruguay-4 Adamsfield Uruguay Uruguaydir Uruguay staticfield Argentina Argentinafieldfield Uruguaybio Uruguay Uruguay UruguayMLS defensive Uruguay Uruguay playing defensivehand Uruguay Uruguay Uruguay Uruguaycid Uruguay competition Uruguay Uruguay Uruguay Uruguay Uruguay Argentina ditch playing Argentina Argentina Uruguay playingMLS Uruguay Uruguay Uruguay Uruguay Uruguay Atlas Uruguay-173-2 Uruguay Uruguay Uruguay Uruguay Argentina Uruguay Uruguay Schwe joined-4-18 competition Uruguayfield Uruguayfield Uruguay Uruguay UruguayDef France Uruguay playing Argentina Algeriaback3-2 Uruguay Uruguayfield AdamsfieldMLS Uruguayfield Argentinabio competition Uruguay Uruguayfield Chifield Uruguay Uruguay Uruguay defensivefield Uruguay Uruguay Uruguay Uruguay Uruguay playing Argentina Uruguay playing Uruguay playing Uruguay Argentina Uruguay Uruguay ArgentinafieldfieldMLS Argentina Uruguayfield defensive 1 Uruguay Algeria Manchesterfield Uruguay Uruguayfieldfield Adams playing Argentinaa Uruguay Uruguay Argentinafield centre Adams Uruguay surely Adams Argentina3-2field-18fieldLET Uruguay Germany Uruguay Alt centre Uruguay Uruguay Uruguay Uruguay playing Uruguayjarfieldfield Uruguay Uruguay Uruguay playing Bull Uruguay Uruguay prepared Argentina Argentina Argentina defensive Uruguayfield UruguayMLS Mexicofield Uruguay Gu surely defensive Uruguay Uruguay Uruguay Mess Carlos Uruguayfield Franceback competitionfield Uruguay ditch knock Germany Uruguay Uruguay Uruguaysided Uruguay competitionlopMLS Uruguayfieldv conflict Uruguay Uruguay Uruguay Uruguay predictable Uruguay Uruguay Mull Uruguay UruguayMLS competition playing playing Uruguay Uruguay Uruguayfield Uruguay Argentina Nigeria Uruguay competition playing Uruguay-18 Argentina camps centre Uruguay Uruguay Uruguay Uruguay playing Uruguay Uruguay Adams making Uruguay Uruguayfield Uruguay playingMLS Alt midhandfield Uruguay Uruguay Uruguay Uruguay Korea Uruguay England-18 Argentinaooney Uruguay Uruguay Uruguay midfield Uruguay playingfield four Argentina recommendationsfield Lion Adamsfield ArgentinaLET defensive Uruguay Uruguay defensive Uruguayfield Uruguay Uruguayfield playing Uruguay Uruguay competition Uruguay Uruguay Uruguay Argentinajarfield playing Uruguay Uruguay Uruguay Uruguay playing mid Uruguayfield England Uruguay Uruguay Uruguay Uruguay Ashley Argentina Uruguayfield Adams Argentina Argentina and mid Carlos force Adams surely Uruguay playing Argentina surely competition playing Argentina Uruguay competition tactical tactical Uruguayfield Uruguay Uruguay Gu Uruguay UruguayMLS Uruguay hitting Uruguay Argentina Adams Uruguay Uruguay Uruguay Uruguay Schwe hitting surelyfieldvert After playing Uruguay Homebol Uruguay Uruguay Uruguay Uruguayfield playing Uruguay three Uruguaygrown competition Uruguay Uruguayfield itfieldste Uruguay Uruguay Uruguayfield Argentinarez playing Uruguay Adams tactical", "stripped_text": "Ghana England playing Uruguay competition playing Argentina Adams Gu Argentina playing Lion Uruguaypre Ghana Uruguay Gu result Uruguay Uruguay Uruguay Adams Uruguay competitionsidedMLS Ghana playing-4 Uruguay vorbe Ghana Uruguay competition Lion Uruguay Argentina tactical Uruguay Argentina Uruguay Uruguay Schwe Ghana Uruguay surely Uruguay Uruguaymain Uruguayrez-17field Argentina ArgentinaachievinggrownLET Uruguay Adamsfield playing competitionfieldfield playingeira Uruguay Uruguay Uruguay deep Argentinafield Uruguayrez deepDef Uruguay playing Uruguay Argentina centrebackrez-4field competition Jews Uruguayfieldfieldfield Uruguay playing midfield Uruguay Uruguay playing Uruguay playing centre surely playing Uruguayfield Uruguay Uruguayjar Uruguay Argentina Uruguay playingfield-4field competition South Uruguay competition Uruguayfield Adams Uruguay competition Argentina competitionfield Mexican playing Uruguay Uruguay UruguayMLS UruguayMLS Uruguay Uruguay Uruguay competition Uruguay Uruguay-4 Ex tactical playing Uruguay Uruguay mid1-0 Uruguay3-2 Gu Uruguay Uruguay Uruguay Uruguay Bull Cup joined Uruguay Uruguayhand Germanfield playing Uruguay Uruguayfieldrez Uruguay Dolphin competition Argentina Uruguay UruguayjarDefafter surely Uruguay Mexico competition Uruguay Argentina Adams playing Uruguay Uruguay AdamsLETbackDefMLS defensivebio Uruguayrez competition competition defensive competition Uruguay Uruguay Uruguay Uruguay Uruguayfield Uruguay onto Uruguay Adams Uruguay Uruguayfield France UruguayDefMLS Uruguay Adams Gufieldrainfield possession Uruguayfield Adamsfield playing Uruguay Uruguay Uruguay Uruguay3-2 Uruguay Uruguay Uruguayfield Uruguay Uruguay playing Uruguay Uruguay centre playing Uruguay Nazi Uruguay ArgentinaMLS Uruguay Alt competition Uruguay Uruguay permanently Ghana Carlos playing-2 Uruguay playing Uruguay Atlas disciplineback playingstefield Uruguay Uruguay Argentina playing Argentina Uruguay playing playingfield fluid Uruguay Adams Uruguay Uruguay Uruguay-4 useful playing Uruguay-18field Uruguay Uruguay3-2 centre Uruguay playing Uruguayemploi Argentina-18 Uruguay Uruguaydir Adams EnglandMLS Uruguayfield3-2 defensivefield Argentina ArgentinaMLS Argentina Uruguay Uruguay Uruguay Uruguayafield Argentina Uruguayfield discipline-4field Uruguayfieldfield Uruguayfield Uruguay Argentinafield Mess competition competition Mull only Adams Uruguay Uruguay Uruguay Uruguay Uruguay Uruguay surely Uruguay surely Uruguay Uruguay playing Lion Uruguay Uruguay Uruguay playing Ghana-17 Adams tacticalfieldste Uruguay Ghana Uruguay Argentina Uruguay Adams Adams Uruguay Carlos’ playing surely Argentina Uruguay-4 Uruguayfield Uruguay Uruguayfield Uruguay playingfield omuluibioste competitionfield Adams Uruguay-4 Uruguay Uruguay Germany playingfield Uruguay Uruguay tactical Uruguay Uruguayfield of Uruguay playingfield-4 surelyfield Uruguay past Uruguayjar Uruguayfield Argentina collaborate route competition Ashley Uruguaycid surely Argentina Uruguay-4field-4 Uruguay Uruguay Argentinafield competition Argentina Argentina Adams Uruguay Argentina Uruguay competitionfield competition Uruguay Gu Uruguay Uruguay Argentina Uruguay Uruguayfield Gonzfield hitting-17 playing Adams Uruguayste Uruguay Uruguay Uruguay KillMLSfieldfield Uruguay mid Uruguay Mexico Uruguay Gu Uruguay Argentina Uruguay Uruguayfield competition Uruguay Adams Uruguayfield playingrez playinglev playing Uruguay Uruguay Argentina Argentina-18 defensivefield playing Adams Uruguayfield Uruguay playing Argentina playingfield Uruguay Uruguay Uruguay Uruguay Uruguay Uruguay Uruguay Argentina Argentinafieldfield Uruguay playingfield Uruguay Uruguaydelegates Adams SchwebackDeffieldDef Uruguayfield Argentinafield playingfield grabbe Uruguaybio Uruguay-18 playing competitionfield competition Argentina Uruguay Uruguay Argentina Uruguay competition competition Uruguay Jews usually Bob playing Uruguay Uruguay Uruguay Gu Cap defensivefield mid China Uruguay Argentina Uruguay Uruguay playingUL Uruguay Argentina Uruguay Lion surelyfield Uruguay Uruguay UruguayMLS Uruguay Uruguay Uruguay retention Gu Uruguayfield playing Uruguayfield surely Mullfield surely playing Argentina Uruguay Uruguay Uruguay Argentina donne Uruguay surely surely Uruguay Uruguay Uruguay Uruguay centre Uruguay competition Uruguay Uruguay Gonz Uruguay Uruguay Argentina Uruguay Uruguay-4 Adamsfield Uruguay Uruguaydir Uruguay staticfield Argentina Argentinafieldfield Uruguaybio Uruguay Uruguay UruguayMLS defensive Uruguay Uruguay playing defensivehand Uruguay Uruguay Uruguay Uruguaycid Uruguay competition Uruguay Uruguay Uruguay Uruguay Uruguay Argentina ditch playing Argentina Argentina Uruguay playingMLS Uruguay Uruguay Uruguay Uruguay Uruguay Atlas Uruguay-173-2 Uruguay Uruguay Uruguay Uruguay Argentina Uruguay Uruguay Schwe joined-4-18 competition Uruguayfield Uruguayfield Uruguay Uruguay UruguayDef France Uruguay playing Argentina Algeriaback3-2 Uruguay Uruguayfield AdamsfieldMLS Uruguayfield Argentinabio competition Uruguay Uruguayfield Chifield Uruguay Uruguay Uruguay defensivefield Uruguay Uruguay Uruguay Uruguay Uruguay playing Argentina Uruguay playing Uruguay playing Uruguay Argentina Uruguay Uruguay ArgentinafieldfieldMLS Argentina Uruguayfield defensive 1 Uruguay Algeria Manchesterfield Uruguay Uruguayfieldfield Adams playing Argentinaa Uruguay Uruguay Argentinafield centre Adams Uruguay surely Adams Argentina3-2field-18fieldLET Uruguay Germany Uruguay Alt centre Uruguay Uruguay Uruguay Uruguay playing Uruguayjarfieldfield Uruguay Uruguay Uruguay playing Bull Uruguay Uruguay prepared Argentina Argentina Argentina defensive Uruguayfield UruguayMLS Mexicofield Uruguay Gu surely defensive Uruguay Uruguay Uruguay Mess Carlos Uruguayfield Franceback competitionfield Uruguay ditch knock Germany Uruguay Uruguay Uruguaysided Uruguay competitionlopMLS Uruguayfieldv conflict Uruguay Uruguay Uruguay Uruguay predictable Uruguay Uruguay Mull Uruguay UruguayMLS competition playing playing Uruguay Uruguay Uruguayfield Uruguay Argentina Nigeria Uruguay competition playing Uruguay-18 Argentina camps centre Uruguay Uruguay Uruguay Uruguay playing Uruguay Uruguay Adams making Uruguay Uruguayfield Uruguay playingMLS Alt midhandfield Uruguay Uruguay Uruguay Uruguay Korea Uruguay England-18 Argentinaooney Uruguay Uruguay Uruguay midfield Uruguay playingfield four Argentina recommendationsfield Lion Adamsfield ArgentinaLET defensive Uruguay Uruguay defensive Uruguayfield Uruguay Uruguayfield playing Uruguay Uruguay competition Uruguay Uruguay Uruguay Argentinajarfield playing Uruguay Uruguay Uruguay Uruguay playing mid Uruguayfield England Uruguay Uruguay Uruguay Uruguay Ashley Argentina Uruguayfield Adams Argentina Argentina and mid Carlos force Adams surely Uruguay playing Argentina surely competition playing Argentina Uruguay competition tactical tactical Uruguayfield Uruguay Uruguay Gu Uruguay UruguayMLS Uruguay hitting Uruguay Argentina Adams Uruguay Uruguay Uruguay Uruguay Schwe hitting surelyfieldvert After playing Uruguay Homebol Uruguay Uruguay Uruguay Uruguayfield playing Uruguay three Uruguaygrown competition Uruguay Uruguayfield itfieldste Uruguay Uruguay Uruguayfield Argentinarez playing Uruguay Adams tactical"} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 1, "raw_text": "field playing deepREDfield Uruguay-18 playing Adams Uruguay Uruguay Uruguay Uruguay Uruguay permanently Uruguay Gu surely Adams Uruguay Adams Uruguay Ghana competition Uruguayfield Uruguay-4fieldfield Uruguay Land Uruguay Adamshand competition defensive Adams defensivefieldMLS of Adamsfield Uruguay Uruguay Uruguay Adams playing Uruguay Argentina Uruguay Atlasfield UruguayDeffield-17field playing Adams-18MLS competition song Adams Uruguay Argentina Uruguay Uruguay playing Uruguay-17 Uruguay Schwe Uruguay Uruguay Adams Bradley Australia Adams Uruguay competition Adams Uruguayfield Uruguay AdamsMLS Uruguay Uruguay competitionfield hitting competitionMLS-4 Lionello Argentinaif Uruguay Uruguayfield UruguayhandLET Uruguay3-2 Uruguay Adams competition playing Uruguay Uruguay Uruguay Uruguay Uruguay FranceIL Argentina Uruguay competition playing playing Uruguay Uruguay Uruguay Tyler Uruguay Uruguay Adams Uruguayfield Uruguay Uruguay Adams Uruguay Uruguay surely Uruguay-18 Argentina Uruguay defensive Uruguay Uruguay UruguayMLSfieldfield playing Uruguay competition Uruguay Uruguay Uruguay France AdamsfieldMLS Gu competition Uruguay defensive playing Argentina Uruguay possession Uruguay playing Argentina surely Uruguay Gu Uruguay Uruguay Uruguayfield Uruguayfield defensivefield Uruguay Uruguay Uruguay Chi Argentinaooney Uruguay playing Uruguayfield canopy pacefield Uruguay Uruguay Uruguay Uruguay Chifield playing Uruguay who Uruguay-4 Uruguay Argentina Uruguay Uruguay competition Mess Uruguay Argentina Uruguayfield Uruguay Argentina Uruguayback Lion playing competitionfield Uruguay Uruguayfield Uruguayfield Uruguay-17field playing defensivefield drift Uruguay playing Uruguay competition3-2field-4field Uruguayfield it Argentina Uruguay Uruguay Uruguayfield competition Uruguay competition deep Uruguayfield Uruguay Adams Adams Atlas competition-4LET competition Uruguay-4 playing Chifield Uruguay Adams playing Uruguay will Cup Schwe Adams Uruguay Argentina Uruguay Uruguay Uruguay defensive Adamsfounded Gu threat Uruguay Uruguay Uruguay Argentina playing Uruguay Uruguay Uruguay Uruguay Argentina competition competition France Uruguayrez Schwe Uruguay Argentinafield Adams competition Bull Uruguayfield Adams playing Uruguay tactical Uruguay playing surely playing competition tactical Uruguay Tyler Argentina UruguayMLS opposed Uruguay playing Nigeria Uruguay competition Uruguay competition-4rez UruguayMLS Adams competition defensiveMLS Uruguay Argentina Schwe German defensive Uruguay competition Uruguay Adams Uruguay Uruguay Uruguay playingfield play Uruguayfield Uruguay Uruguay Uruguayfield playing mid Uruguayfield UruguayfieldLET playing Uruguay tactical Uruguay Mexico Uruguay Adams-17 Uruguayrez Uruguay competition Germany Uruguay Argentina Uruguay Uruguay Uruguayfield mid Uruguay Uruguayjar Adams Uruguay Uruguay competition Uruguay England markers Uruguay Uruguay-4 Uruguay GhanaMLS Uruguay Uruguay competition Uruguay Uruguay Uruguay playing properly-18 Uruguay midgrown Uruguay Schweback playingMLS Uruguay permanentlyfield Uruguay Uruguay Uruguay competition Argentina competition Uruguay residency mid Uruguayjar surely Gu Adams build nativeu coming Uruguay UruguayDef competition Uruguay Uruguay Uruguay ArgentinaLET Uruguaysettlers Uruguay Uruguay competitionMLS Uruguay ArgentinaMLSLETLET playing Uruguay stretched Uruguay playing playing Uruguayfield UruguayMLS Adams Argentina Argentina Uruguay Argentina Adams Te Argentina surely Gufield Uruguay Uruguay Adams-18 8:30 Adams playing Uruguay competition Uruguay Argentina Argentinafield Argentinalop competition Uruguay Gu defensivefield UruguayLET defensive playing Uruguay Uruguay competition playing Germany permanentlyfield ArgentinaMLSfield Adams playing Uruguay Uruguay Uruguay Uruguay playingfieldfield playing Gu-4 Altfield Adams competition competition Uruguay Adams centre Argentina Uruguay centre competition infections Uruguay playingMLS Uruguay Uruguayfield competitionfield Uruguay Adams Uruguay Uruguay Uruguay defensive-18 Uruguay Uruguay Uruguay Uruguayfield Uruguay Uruguay Argentina Uruguay Adams-4 Adams Argentina Uruguayfield Uruguay Uruguay Uruguay Uruguay Uruguay discipline pace Uruguayfield Adamsregain Uruguay-18ILfield Uruguay Adams playing Uruguay Adams Uruguay Uruguayfield competitionfieldooney Uruguay surely virtually UruguayMLS Uruguay tactical playing Gu Uruguay centre-4 Mess Uruguay Uruguay Argentina mid Nigeriafield meals surely Uruguay Uruguay Uruguay Uruguay Uruguay Uruguay Uruguay-17 Bull Uruguayfield Carlos field Uruguay Uruguay UruguayMLS Uruguay playing Uruguay Uruguay Argentina UruguayLET Argentina Uruguay Uruguay Adams Uruguay Uruguay Uruguay competition UruguayMLS-4 competition Uruguay attacking competition Uruguay mid defensive3-2 Uruguay Uruguay playing Uruguay Gu defensive defensive Uruguay Uruguay Uruguay Uruguay Uruguay Carlos tracking Uruguay Uruguayfield playingfield playing Uruguayfield Uruguay Uruguay Uruguay Mas Uruguay Adamsfield Tyler Uruguay Pick Argentina Uruguay Uruguayfield Argentina Uruguay Uruguayfield defensive Uruguay Uruguay THE Uruguayfield Uruguay Uruguay Uruguay Uruguay Uruguay UruguayLET Ashleyfieldfield Argentinafield Uruguay Argentinafield Adams-18 competition Uruguay Uruguay surely Nigeria Uruguay Uruguayrezating tactical Uruguay MessLETfield Carlos playing surely surely Argentina Uruguay Gusided playing Uruguayfield Argentina Uruguayfield Uruguay Cup Uruguay playing Uruguay competition Uruguay Uruguay UruguayfieldMLS Uruguay Argentina Mull Uruguayfield Uruguayfield Uruguay Uruguay Ghana Uruguay Cup Uruguay Uruguay Cap Uruguay playing defensive competition Uruguayback Top competitionfield playing Uruguay Uruguay Argentina Uruguayfield Uruguay battle fluid Uruguay defensive Uruguay Argentina Uruguay Uruguay competitionfield Uruguay Uruguay Uruguay Argentina competition Uruguay centre Uruguay Uruguay Uruguay playing Uruguay Uruguayfield surely Uruguay Argentina Uruguay Argentina Uruguay competition Uruguay Uruguay Schweback-4 Australia Uruguay Uruguay turnsbackfield Uruguay Uruguayfield jointfieldfield Uruguay Uruguay-18 Ghana Ghana tactical Uruguay Uruguay deep playing Uruguay Uruguay Argentinafield playing Uruguay Uruguay competition Uruguay playing Uruguay Argentinafield Adams Uruguay Adamsfieldfield competitionback Uruguay Adams-18 tactical Uruguay Uruguay Uruguay Argentina defensive playing Uruguayfield UruguaybolVCsettlersMLS-18 routefield Uruguay Uruguay Uruguay Pick Uruguay andfield centre Argentina Argentinafield Uruguay Uruguay Uruguay tacticalfield Argentina deep Uruguay4-0 Uruguayste defensiveDef Ghana Uruguay Uruguay Argentina Uruguay Uruguay as competition Adams3-2 playing Adams competitionste Uruguay Uruguay Uruguayrezfield Uruguayfield Uruguay Adamsfield UruguayMLS Argentina playingMLS mid Uruguay Adams Adams Argentinafield route Uruguay Uruguay Argentina3-2 Uruguay Argentina line Uruguay Uruguay Uruguay Argentina Argentinafield Argentina Uruguay Argentina North surely Uruguay competition-18 Adams playing Uruguay playing Uruguay Adams Uruguay playing Adams threatfield playing tactical Uruguay UruguayhandMLS playing Uruguay Uruguay Argentina UruguayMLS-4 playing Uruguay Adams surely Uruguay Argentina Ghana Mongolia Gonz Uruguay Uruguay playing playing Chi Uruguay Uruguay Adams turns Uruguay", "stripped_text": "field playing deepREDfield Uruguay-18 playing Adams Uruguay Uruguay Uruguay Uruguay Uruguay permanently Uruguay Gu surely Adams Uruguay Adams Uruguay Ghana competition Uruguayfield Uruguay-4fieldfield Uruguay Land Uruguay Adamshand competition defensive Adams defensivefieldMLS of Adamsfield Uruguay Uruguay Uruguay Adams playing Uruguay Argentina Uruguay Atlasfield UruguayDeffield-17field playing Adams-18MLS competition song Adams Uruguay Argentina Uruguay Uruguay playing Uruguay-17 Uruguay Schwe Uruguay Uruguay Adams Bradley Australia Adams Uruguay competition Adams Uruguayfield Uruguay AdamsMLS Uruguay Uruguay competitionfield hitting competitionMLS-4 Lionello Argentinaif Uruguay Uruguayfield UruguayhandLET Uruguay3-2 Uruguay Adams competition playing Uruguay Uruguay Uruguay Uruguay Uruguay FranceIL Argentina Uruguay competition playing playing Uruguay Uruguay Uruguay Tyler Uruguay Uruguay Adams Uruguayfield Uruguay Uruguay Adams Uruguay Uruguay surely Uruguay-18 Argentina Uruguay defensive Uruguay Uruguay UruguayMLSfieldfield playing Uruguay competition Uruguay Uruguay Uruguay France AdamsfieldMLS Gu competition Uruguay defensive playing Argentina Uruguay possession Uruguay playing Argentina surely Uruguay Gu Uruguay Uruguay Uruguayfield Uruguayfield defensivefield Uruguay Uruguay Uruguay Chi Argentinaooney Uruguay playing Uruguayfield canopy pacefield Uruguay Uruguay Uruguay Uruguay Chifield playing Uruguay who Uruguay-4 Uruguay Argentina Uruguay Uruguay competition Mess Uruguay Argentina Uruguayfield Uruguay Argentina Uruguayback Lion playing competitionfield Uruguay Uruguayfield Uruguayfield Uruguay-17field playing defensivefield drift Uruguay playing Uruguay competition3-2field-4field Uruguayfield it Argentina Uruguay Uruguay Uruguayfield competition Uruguay competition deep Uruguayfield Uruguay Adams Adams Atlas competition-4LET competition Uruguay-4 playing Chifield Uruguay Adams playing Uruguay will Cup Schwe Adams Uruguay Argentina Uruguay Uruguay Uruguay defensive Adamsfounded Gu threat Uruguay Uruguay Uruguay Argentina playing Uruguay Uruguay Uruguay Uruguay Argentina competition competition France Uruguayrez Schwe Uruguay Argentinafield Adams competition Bull Uruguayfield Adams playing Uruguay tactical Uruguay playing surely playing competition tactical Uruguay Tyler Argentina UruguayMLS opposed Uruguay playing Nigeria Uruguay competition Uruguay competition-4rez UruguayMLS Adams competition defensiveMLS Uruguay Argentina Schwe German defensive Uruguay competition Uruguay Adams Uruguay Uruguay Uruguay playingfield play Uruguayfield Uruguay Uruguay Uruguayfield playing mid Uruguayfield UruguayfieldLET playing Uruguay tactical Uruguay Mexico Uruguay Adams-17 Uruguayrez Uruguay competition Germany Uruguay Argentina Uruguay Uruguay Uruguayfield mid Uruguay Uruguayjar Adams Uruguay Uruguay competition Uruguay England markers Uruguay Uruguay-4 Uruguay GhanaMLS Uruguay Uruguay competition Uruguay Uruguay Uruguay playing properly-18 Uruguay midgrown Uruguay Schweback playingMLS Uruguay permanentlyfield Uruguay Uruguay Uruguay competition Argentina competition Uruguay residency mid Uruguayjar surely Gu Adams build nativeu coming Uruguay UruguayDef competition Uruguay Uruguay Uruguay ArgentinaLET Uruguaysettlers Uruguay Uruguay competitionMLS Uruguay ArgentinaMLSLETLET playing Uruguay stretched Uruguay playing playing Uruguayfield UruguayMLS Adams Argentina Argentina Uruguay Argentina Adams Te Argentina surely Gufield Uruguay Uruguay Adams-18 8:30 Adams playing Uruguay competition Uruguay Argentina Argentinafield Argentinalop competition Uruguay Gu defensivefield UruguayLET defensive playing Uruguay Uruguay competition playing Germany permanentlyfield ArgentinaMLSfield Adams playing Uruguay Uruguay Uruguay Uruguay playingfieldfield playing Gu-4 Altfield Adams competition competition Uruguay Adams centre Argentina Uruguay centre competition infections Uruguay playingMLS Uruguay Uruguayfield competitionfield Uruguay Adams Uruguay Uruguay Uruguay defensive-18 Uruguay Uruguay Uruguay Uruguayfield Uruguay Uruguay Argentina Uruguay Adams-4 Adams Argentina Uruguayfield Uruguay Uruguay Uruguay Uruguay Uruguay discipline pace Uruguayfield Adamsregain Uruguay-18ILfield Uruguay Adams playing Uruguay Adams Uruguay Uruguayfield competitionfieldooney Uruguay surely virtually UruguayMLS Uruguay tactical playing Gu Uruguay centre-4 Mess Uruguay Uruguay Argentina mid Nigeriafield meals surely Uruguay Uruguay Uruguay Uruguay Uruguay Uruguay Uruguay-17 Bull Uruguayfield Carlos field Uruguay Uruguay UruguayMLS Uruguay playing Uruguay Uruguay Argentina UruguayLET Argentina Uruguay Uruguay Adams Uruguay Uruguay Uruguay competition UruguayMLS-4 competition Uruguay attacking competition Uruguay mid defensive3-2 Uruguay Uruguay playing Uruguay Gu defensive defensive Uruguay Uruguay Uruguay Uruguay Uruguay Carlos tracking Uruguay Uruguayfield playingfield playing Uruguayfield Uruguay Uruguay Uruguay Mas Uruguay Adamsfield Tyler Uruguay Pick Argentina Uruguay Uruguayfield Argentina Uruguay Uruguayfield defensive Uruguay Uruguay THE Uruguayfield Uruguay Uruguay Uruguay Uruguay Uruguay UruguayLET Ashleyfieldfield Argentinafield Uruguay Argentinafield Adams-18 competition Uruguay Uruguay surely Nigeria Uruguay Uruguayrezating tactical Uruguay MessLETfield Carlos playing surely surely Argentina Uruguay Gusided playing Uruguayfield Argentina Uruguayfield Uruguay Cup Uruguay playing Uruguay competition Uruguay Uruguay UruguayfieldMLS Uruguay Argentina Mull Uruguayfield Uruguayfield Uruguay Uruguay Ghana Uruguay Cup Uruguay Uruguay Cap Uruguay playing defensive competition Uruguayback Top competitionfield playing Uruguay Uruguay Argentina Uruguayfield Uruguay battle fluid Uruguay defensive Uruguay Argentina Uruguay Uruguay competitionfield Uruguay Uruguay Uruguay Argentina competition Uruguay centre Uruguay Uruguay Uruguay playing Uruguay Uruguayfield surely Uruguay Argentina Uruguay Argentina Uruguay competition Uruguay Uruguay Schweback-4 Australia Uruguay Uruguay turnsbackfield Uruguay Uruguayfield jointfieldfield Uruguay Uruguay-18 Ghana Ghana tactical Uruguay Uruguay deep playing Uruguay Uruguay Argentinafield playing Uruguay Uruguay competition Uruguay playing Uruguay Argentinafield Adams Uruguay Adamsfieldfield competitionback Uruguay Adams-18 tactical Uruguay Uruguay Uruguay Argentina defensive playing Uruguayfield UruguaybolVCsettlersMLS-18 routefield Uruguay Uruguay Uruguay Pick Uruguay andfield centre Argentina Argentinafield Uruguay Uruguay Uruguay tacticalfield Argentina deep Uruguay4-0 Uruguayste defensiveDef Ghana Uruguay Uruguay Argentina Uruguay Uruguay as competition Adams3-2 playing Adams competitionste Uruguay Uruguay Uruguayrezfield Uruguayfield Uruguay Adamsfield UruguayMLS Argentina playingMLS mid Uruguay Adams Adams Argentinafield route Uruguay Uruguay Argentina3-2 Uruguay Argentina line Uruguay Uruguay Uruguay Argentina Argentinafield Argentina Uruguay Argentina North surely Uruguay competition-18 Adams playing Uruguay playing Uruguay Adams Uruguay playing Adams threatfield playing tactical Uruguay UruguayhandMLS playing Uruguay Uruguay Argentina UruguayMLS-4 playing Uruguay Adams surely Uruguay Argentina Ghana Mongolia Gonz Uruguay Uruguay playing playing Chi Uruguay Uruguay Adams turns Uruguay"} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 2, "raw_text": "playing Uruguay Uruguay AltMLS Uruguay Uruguay competition playing Uruguay tacticalgrown hafieldfield Uruguay playing playing competition defensive Uruguay Uruguay Uruguayfield Friedfieldrez Uruguaycher Uruguay Adamsfieldello playing Uruguay Adams Uruguay playing playing playingfield cameras Uruguay Uruguaylan Uruguay Uruguay playingback France Adams Uruguay Schwefield Uruguay competition Uruguay Uruguayfield competition competition FrancefieldMLS deep Uruguay Uruguaysided mid fluid tacticalka Uruguay defensive Home Argentina Uruguay Uruguayfield playingfield Uruguay Adamsrez Bull playing Uruguay Uruguayrez playing Uruguay Uruguay Uruguay Uruguay Uruguayhand Schweigerfield France Uruguay Tyler-18 Uruguay Related Adams adequate Uruguaygrez Uruguay playing Uruguayrez stretchedfield Uruguay 2015. Uruguay Uruguay-18 Germanyrez competition Alt Uruguay Adamsfieldfield UruguayGrafieldfield AdamsMLS1-0 Uruguay playing Uruguay Argentina Uruguay Uruguay Uruguaydir ArgentinaDef playing Uruguayfield playingMLS Adams Uruguay Uruguay Uruguay-18hand-4 Uruguay playing defencefield France mid Uruguay Adamsvez permanently Uruguay3-2 Uruguay Uruguay Uruguayfieldfield3-2 playing France Adams Uruguay possession Uruguay playing Uruguay Uruguayfield Schwe Uruguayfield-18 Argentina competition playing Uruguayeira Uruguayfield Uruguay-18 surely Uruguay Uruguay Uruguay Uruguay Gu-18 playing Adams Uruguayfield Uruguay ArgentinadirfieldfieldMLS surelyDef Argentina Uruguay Mess Adams Schwe3-2 Uruguay Adams Argentina competitionrez mid Australiafield competition Uruguay surely Uruguay Uruguay Argentinafield competition competition Ghana surely defence uses Adams leftfield playing Adams represented Uruguay defensive Uruguayfield Uruguay Uruguay competition Uruguay playing Ghana Uruguay Uruguay Uruguay retention Argentina Uruguay Uruguay supportsfield-18 Argentina Adams Uruguay competition Uruguay surely playing Uruguayfieldrez Uruguay Uruguay surelyfield UruguayfieldMLS Uruguay Uruguay competitionfield competition defensive Uruguay Uruguay Uruguay Uruguay Adams Uruguay centre Argentina Uruguay permanently Argentina competition Uruguayfield Uruguay Argentina playing competition competitionsidedste– Uruguay Uruguayfield Uruguay Lion Argentina Mess Uruguay Gonzfield Adams playing competitionfield Uruguay ArgentinaMLSbackfield outfield Uruguayfield competition Uruguay defensive Uruguay Uruguay Uruguay discipline competition Uruguay Uruguay Uruguay playingbio Adams Uruguay playing Gu Uruguay-18rez Uruguay too Uruguay route Uruguay competitionfield Adams competition passengers Uruguay Cup playing Carlosfieldfield Uruguay Ashley UruguayLET Uruguay defensive Uruguay Uruguay Uruguay midfield Uruguay UruguayLETMLS discipline AdamsDef defensive surely Uruguay Uruguay Cine Uruguay Uruguay Uruguay stretchedrez-4 Uruguay playing Chi Uruguay Adamshand Uruguay THE playing playing Uruguay Argentina defensivehand playing playing Uruguay Uruguay tacticalfieldfield playing-18 Uruguay Adams centre Uruguay Uruguay Uruguay Schwe Adams competition Uruguay Uruguay Uruguay playing Uruguay competitionrashsteste-2 Adamsrez playing Uruguay Uruguay Uruguay Thefield Mas Uruguay Uruguay Uruguayooney playing playing permanently playing defencefield Uruguay Uruguayfield Uruguay Uruguayfieldgrown playing-18 logo Uruguay Uruguay Uruguay Schwe-4 Uruguay Gonz German Uruguay Uruguay Uruguay centrefield Uruguay Uruguay playing-18 surelyfield Uruguay Uruguayfieldfield defencefield route playing Uruguay Argentina playing Uruguay-4field Germany Uruguay Uruguay Uruguay Uruguay playing Uruguayrez Argentina midfield playing UruguayDefsettlersfield Uruguay Adams Uruguay playing Uruguay stick South Uruguayfield playingfield Uruguayfield Uruguay surely Uruguay competition’ Uruguay Uruguay Argentina Argentina-4 Argentina Mexico route Uruguay AdamsjarDef surely Adamsrez Uruguay Uruguay Uruguay competition Uruguay playing Uruguay competitionfield Uruguaybiofielddirfield Uruguay retention Uruguayfieldfieldfield recording Uruguay Uruguay Uruguay centrefield Uruguay Uruguay Uruguay defensive Adams Uruguay Uruguay Ghana Uruguayfield Argentina Uruguay playing competition native Germany Adams mid Uruguay Uruguay Uruguay playing Uruguay deepfield playing Uruguay Uruguay Adamsjar Uruguay surely playing Uruguay Uruguay Carlos Uruguay Uruguay Uruguay-18field Uruguay Uruguayfield Uruguay Argentina Uruguay experiment Uruguay Rafael Uruguay Uruguay Uruguay Uruguay centrefield Uruguay Uruguay Uruguay defence Uruguayfield Uruguay deep UruguayMLS Adams Uruguay UruguayfieldMLS midback Uruguay Uruguay playing Argentina Uruguay Adams Uruguay Uruguay Uruguayfield Uruguay competition competitionfield Uruguay Uruguay Argentina THE Uruguayfield impressed Uruguay Uruguay Mexican Argentina surely Adams competition Uruguay Uruguay Uruguay Uruguay Adams AdamsfieldfieldfieldMLS Uruguay playing Argentina Uruguay Uruguayrez playing Uruguay surelyfield Uruguay Uruguay Uruguayste defensiveMLS Uruguay UruguayfieldMLS share Uruguay Uruguay playing Uruguay Uruguay playinglop Uruguay favourite Argentina Uruguay Uruguay Argentina Mess Carlos Uruguay playing Uruguay Germany playing Uruguay Uruguayjar Uruguayfield Uruguay Argentina Nazi England or Gu Adamsfieldfield Uruguay Uruguay against Argentina Argentina Uruguayfield Uruguay Uruguay Uruguayste Bull player playing Uruguay Uruguay competition Uruguay Argentina Uruguayfield competition Uruguayfield playing Uruguaygrabbing Nazi surely Uruguay permanently Diego Argentina centre of at Rafaelfield Uruguay Uruguay Uruguay competition defensiveMLS Uruguayfieldfield4-0field Uruguay Uruguay Argentina playing Uruguay maderez Uruguay surelyMLSfield Uruguay Uruguay Uruguay Uruguay the competitionMLS competition Uruguay containMLS Germanyjar Argentina playing competition Uruguay Uruguay competitioncel Uruguay Uruguay Uruguay competition playing Uruguay Uruguay Uruguay competition Carlos Uruguay playingfield Uruguay Uruguay playing Uruguay Adams Uruguay Uruguayhandious competition Uruguayfield Uruguay Carlos Uruguay Argentina Uruguayhand Uruguay permanently competition mid Ghana competition France playing Argentina Uruguay Uruguay Uruguay Uruguay Uruguay UruguayfieldLOT Argentina Uruguay Uruguay Atlas Adamsnet Uruguay Uruguay deep Uruguay software playingfield Uruguay Uruguay Uruguay Uruguay Uruguay playing Uruguay Uruguay playing Uruguay centre Gonzrezrezfield Argentina Uruguay Uruguay playing playingfield Uruguay-18 Adamsdestroyingfield Argentinaback-4 ditch left UruguayMLS Uruguay Uruguay Argentina Ghana centre-field Uruguayfield Ghana Uruguay competition Uruguay Uruguay competition competition Uruguay Uruguay Adams mid central Cup Uruguay playing1-0 competition Argentina Uruguay playingfield Uruguay Uruguay Uruguay UruguayMLS German Uruguay Uruguay playingrash competition Uruguay Uruguay Argentina playingfield playing-4 Uruguay Uruguay tactical discipline Uruguay Uruguay Uruguay Uruguayfieldfield Argentina playing playing Uruguay Uruguayfield playingjar Uruguay Argentina playing Uruguay Uruguay-4 Uruguay Uruguay Argentina Uruguay Uruguay Uruguay object-4fieldsided competition Uruguay Uruguay Uruguay Adams Adams Uruguay Uruguay Gu-4 Uruguayhand Uruguay Uruguay Uruguay Uruguayfield1-0", "stripped_text": "playing Uruguay Uruguay AltMLS Uruguay Uruguay competition playing Uruguay tacticalgrown hafieldfield Uruguay playing playing competition defensive Uruguay Uruguay Uruguayfield Friedfieldrez Uruguaycher Uruguay Adamsfieldello playing Uruguay Adams Uruguay playing playing playingfield cameras Uruguay Uruguaylan Uruguay Uruguay playingback France Adams Uruguay Schwefield Uruguay competition Uruguay Uruguayfield competition competition FrancefieldMLS deep Uruguay Uruguaysided mid fluid tacticalka Uruguay defensive Home Argentina Uruguay Uruguayfield playingfield Uruguay Adamsrez Bull playing Uruguay Uruguayrez playing Uruguay Uruguay Uruguay Uruguay Uruguayhand Schweigerfield France Uruguay Tyler-18 Uruguay Related Adams adequate Uruguaygrez Uruguay playing Uruguayrez stretchedfield Uruguay 2015. Uruguay Uruguay-18 Germanyrez competition Alt Uruguay Adamsfieldfield UruguayGrafieldfield AdamsMLS1-0 Uruguay playing Uruguay Argentina Uruguay Uruguay Uruguaydir ArgentinaDef playing Uruguayfield playingMLS Adams Uruguay Uruguay Uruguay-18hand-4 Uruguay playing defencefield France mid Uruguay Adamsvez permanently Uruguay3-2 Uruguay Uruguay Uruguayfieldfield3-2 playing France Adams Uruguay possession Uruguay playing Uruguay Uruguayfield Schwe Uruguayfield-18 Argentina competition playing Uruguayeira Uruguayfield Uruguay-18 surely Uruguay Uruguay Uruguay Uruguay Gu-18 playing Adams Uruguayfield Uruguay ArgentinadirfieldfieldMLS surelyDef Argentina Uruguay Mess Adams Schwe3-2 Uruguay Adams Argentina competitionrez mid Australiafield competition Uruguay surely Uruguay Uruguay Argentinafield competition competition Ghana surely defence uses Adams leftfield playing Adams represented Uruguay defensive Uruguayfield Uruguay Uruguay competition Uruguay playing Ghana Uruguay Uruguay Uruguay retention Argentina Uruguay Uruguay supportsfield-18 Argentina Adams Uruguay competition Uruguay surely playing Uruguayfieldrez Uruguay Uruguay surelyfield UruguayfieldMLS Uruguay Uruguay competitionfield competition defensive Uruguay Uruguay Uruguay Uruguay Adams Uruguay centre Argentina Uruguay permanently Argentina competition Uruguayfield Uruguay Argentina playing competition competitionsidedste– Uruguay Uruguayfield Uruguay Lion Argentina Mess Uruguay Gonzfield Adams playing competitionfield Uruguay ArgentinaMLSbackfield outfield Uruguayfield competition Uruguay defensive Uruguay Uruguay Uruguay discipline competition Uruguay Uruguay Uruguay playingbio Adams Uruguay playing Gu Uruguay-18rez Uruguay too Uruguay route Uruguay competitionfield Adams competition passengers Uruguay Cup playing Carlosfieldfield Uruguay Ashley UruguayLET Uruguay defensive Uruguay Uruguay Uruguay midfield Uruguay UruguayLETMLS discipline AdamsDef defensive surely Uruguay Uruguay Cine Uruguay Uruguay Uruguay stretchedrez-4 Uruguay playing Chi Uruguay Adamshand Uruguay THE playing playing Uruguay Argentina defensivehand playing playing Uruguay Uruguay tacticalfieldfield playing-18 Uruguay Adams centre Uruguay Uruguay Uruguay Schwe Adams competition Uruguay Uruguay Uruguay playing Uruguay competitionrashsteste-2 Adamsrez playing Uruguay Uruguay Uruguay Thefield Mas Uruguay Uruguay Uruguayooney playing playing permanently playing defencefield Uruguay Uruguayfield Uruguay Uruguayfieldgrown playing-18 logo Uruguay Uruguay Uruguay Schwe-4 Uruguay Gonz German Uruguay Uruguay Uruguay centrefield Uruguay Uruguay playing-18 surelyfield Uruguay Uruguayfieldfield defencefield route playing Uruguay Argentina playing Uruguay-4field Germany Uruguay Uruguay Uruguay Uruguay playing Uruguayrez Argentina midfield playing UruguayDefsettlersfield Uruguay Adams Uruguay playing Uruguay stick South Uruguayfield playingfield Uruguayfield Uruguay surely Uruguay competition’ Uruguay Uruguay Argentina Argentina-4 Argentina Mexico route Uruguay AdamsjarDef surely Adamsrez Uruguay Uruguay Uruguay competition Uruguay playing Uruguay competitionfield Uruguaybiofielddirfield Uruguay retention Uruguayfieldfieldfield recording Uruguay Uruguay Uruguay centrefield Uruguay Uruguay Uruguay defensive Adams Uruguay Uruguay Ghana Uruguayfield Argentina Uruguay playing competition native Germany Adams mid Uruguay Uruguay Uruguay playing Uruguay deepfield playing Uruguay Uruguay Adamsjar Uruguay surely playing Uruguay Uruguay Carlos Uruguay Uruguay Uruguay-18field Uruguay Uruguayfield Uruguay Argentina Uruguay experiment Uruguay Rafael Uruguay Uruguay Uruguay Uruguay centrefield Uruguay Uruguay Uruguay defence Uruguayfield Uruguay deep UruguayMLS Adams Uruguay UruguayfieldMLS midback Uruguay Uruguay playing Argentina Uruguay Adams Uruguay Uruguay Uruguayfield Uruguay competition competitionfield Uruguay Uruguay Argentina THE Uruguayfield impressed Uruguay Uruguay Mexican Argentina surely Adams competition Uruguay Uruguay Uruguay Uruguay Adams AdamsfieldfieldfieldMLS Uruguay playing Argentina Uruguay Uruguayrez playing Uruguay surelyfield Uruguay Uruguay Uruguayste defensiveMLS Uruguay UruguayfieldMLS share Uruguay Uruguay playing Uruguay Uruguay playinglop Uruguay favourite Argentina Uruguay Uruguay Argentina Mess Carlos Uruguay playing Uruguay Germany playing Uruguay Uruguayjar Uruguayfield Uruguay Argentina Nazi England or Gu Adamsfieldfield Uruguay Uruguay against Argentina Argentina Uruguayfield Uruguay Uruguay Uruguayste Bull player playing Uruguay Uruguay competition Uruguay Argentina Uruguayfield competition Uruguayfield playing Uruguaygrabbing Nazi surely Uruguay permanently Diego Argentina centre of at Rafaelfield Uruguay Uruguay Uruguay competition defensiveMLS Uruguayfieldfield4-0field Uruguay Uruguay Argentina playing Uruguay maderez Uruguay surelyMLSfield Uruguay Uruguay Uruguay Uruguay the competitionMLS competition Uruguay containMLS Germanyjar Argentina playing competition Uruguay Uruguay competitioncel Uruguay Uruguay Uruguay competition playing Uruguay Uruguay Uruguay competition Carlos Uruguay playingfield Uruguay Uruguay playing Uruguay Adams Uruguay Uruguayhandious competition Uruguayfield Uruguay Carlos Uruguay Argentina Uruguayhand Uruguay permanently competition mid Ghana competition France playing Argentina Uruguay Uruguay Uruguay Uruguay Uruguay UruguayfieldLOT Argentina Uruguay Uruguay Atlas Adamsnet Uruguay Uruguay deep Uruguay software playingfield Uruguay Uruguay Uruguay Uruguay Uruguay playing Uruguay Uruguay playing Uruguay centre Gonzrezrezfield Argentina Uruguay Uruguay playing playingfield Uruguay-18 Adamsdestroyingfield Argentinaback-4 ditch left UruguayMLS Uruguay Uruguay Argentina Ghana centre-field Uruguayfield Ghana Uruguay competition Uruguay Uruguay competition competition Uruguay Uruguay Adams mid central Cup Uruguay playing1-0 competition Argentina Uruguay playingfield Uruguay Uruguay Uruguay UruguayMLS German Uruguay Uruguay playingrash competition Uruguay Uruguay Argentina playingfield playing-4 Uruguay Uruguay tactical discipline Uruguay Uruguay Uruguay Uruguayfieldfield Argentina playing playing Uruguay Uruguayfield playingjar Uruguay Argentina playing Uruguay Uruguay-4 Uruguay Uruguay Argentina Uruguay Uruguay Uruguay object-4fieldsided competition Uruguay Uruguay Uruguay Adams Adams Uruguay Uruguay Gu-4 Uruguayhand Uruguay Uruguay Uruguay Uruguayfield1-0"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260518/lta_owt_t5_3l_d256_rollin_p50_randk0_3_logituniform_subset100_600_save100_20260518_144840/decode_step300_dirichlet_resample_c512_flow_state_t1p4_s128_n64.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260518/lta_owt_t5_3l_d256_rollin_p50_randk0_3_logituniform_subset100_600_save100_20260518_144840/decode_step300_dirichlet_resample_c512_flow_state_t1p4_s128_n64.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..5f474426f8a2159d8f2c6b4b40cc0cf88ba14ccb --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260518/lta_owt_t5_3l_d256_rollin_p50_randk0_3_logituniform_subset100_600_save100_20260518_144840/decode_step300_dirichlet_resample_c512_flow_state_t1p4_s128_n64.jsonl @@ -0,0 +1,5 @@ +{"type": "decode_done", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "step": 300, "n_samples": 64} +{"type": "summary", "checkpoint": "runs/lta_owt_t5_3l_d256_rollin_p50_randk0_3_logituniform_subset100_600_save100_20260518_144840/step_0000300.pt", "step": 300, "decode": {"steps": 128, "model_t_mode": "flow", "decode_rule": "dirichlet_resample", "support_power": 1.0, "semantic_power": 1.0, "anchor_mode": "onehot", "cfg_scale": 0.0, "cfg_power": 1.0, "cfg_start": 0.0, "cfg_prior": "uniform", "decode_freq_penalty_alpha": 0.0, "decode_freq_penalty_beta": 0.0, "decode_freq_penalty_floor": 0.0, "decode_freq_penalty_start": 0.0, "decode_freq_penalty_end": 1.0, "decode_freq_penalty_power": 1.0, "start_t": 0.0, "start_init": "noise", "noise_init": "dirichlet", "noise_sigma": -1.0, "dirichlet_concentration": 1.0, "concentration_min": 1.0, "concentration_max": 512.0, "target_prob": 1.0, "endpoint_temp": 1.4, "final_from": "state", "final_sample_mode": "argmax", "final_sample_temp": 1.0, "final_top_k": 64, "final_top_p": 0.95, "final_freq_penalty_alpha": 0.0, "final_freq_penalty_beta": 0.0, "final_freq_penalty_floor": 0.0, "lock_bos": false, "n_samples": 64, "seed": 20260503}, "raw_genppl": {"ppl": 187.38300098636415, "nll_per_token": 5.233154655905331, "tokens": 16320, "kept_samples": 64, "total_samples": 64, "empty_rate": 0.0, "skipped_samples": 0}, "stripped_genppl": {"ppl": 180.54442523364804, "nll_per_token": 5.1959768706677005, "tokens": 16320, "kept_samples": 64, "total_samples": 64, "empty_rate": 0.0, "skipped_samples": 0}, "diversity": {"sample_entropy": 3.548309169221204, "unique_tokens": 433, "token_count": 65536, "distinct_1": 0.0066070556640625, "distinct_2": 0.11491935483870967, "top_token_mass": 0.112518310546875}} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 0, "raw_text": "on the ton be conducted- costs the and were insnt’- in the forn the’ ofa for to There of an that aren moren thebioens on of future’. be we the the ton?n for to’a fromn be inn costs things’ The. is for is the in’ because to of their of havea be, on is be themon modern.. the be modern in on modern in’’ future dis the is ’ that the more, . be The for is. be new in’’’ is ofa were modern be their an. we the costs n. budget were is werebio more future the or to’re theirn the that of conducted and the’ the-n be modernn n wen ofn be to were this and futuren’ the the, be the future the be,n their of then their’’-’ by by.’ are and that of of is future, results’ has’ the be’’ two then the’ ataa of moderns, the’’, the and of budget their for company for d is this The.’ were of is’ some ,an of’ and bya’ their the with’ conducted the of of by of’-f’’ budget future that more. more two their finding future has conducted is of the,surprisingly be be of tonan to don be \",’n the..a beer’ fornera for’ that of havei- it or to. s the’ be other is newn then conducted the.f were to the future be isr be the budget in, is be’ but. andn’ budget conducted, the, the the and. their under then in onn the their and the- the is of any’ be- of and were ,- the the it be- by with of upward were ton future than Karl. theirist’ in of be it’ in thatern.s to the are the be of the be company isn,s Notnn more is’ things’s’ of-- we is their. is were of werea’ be, a.’ budget do.n two for is There future of.’n is the’ in.a’’ bea be’’, to. more the be budget their of be do be., their Not’ is of like, their the their.. the of of, the by er the’’ of at.n do more the the to their of’ budget of.’ and their Some,a and tos of dis on their the’ is have on has’ in be theta be the- be, their future their of or budget’ their the of’ their onan already.'ss were the the for thes to their is the, theirn the’ in, the new’ the ’ their have their toa be’- andn of that of and out.ans budget the, over Not budget’ their-s ofd on some’ in be the, ,’.n’’a’f of for toer’ by, the the the thesa future this– the,’’ in the the the’ we do the is the on ons the’’ of.s the we new -’ is can a isa budget. their may their be out’a. be on on is the the that that be. budget then the that on in the the the we the their an evidence theirad budgeta of, of’ of’ ’ the won in that budget their andn. their budget their the’ the theist. their’n for is their it on be their is their’ on their to’ more’ that for’ be for’ to be be’ ’ budget out be for theirs their more thisn to’ budget and. in is is we by’- be’ we . and dis Some the,’’ the, moren ofa. the. new for’ budget ofer the the,, it said ofn budgetf be be budget their for’ more is. their on to to, dos do to tot of’ be their their their more the their of’ their budget the budget their anderf then budget the that thea best ber ., new the their s budget the best for budget is these the be their out’ on budget the best ons’ be budget ins their on their be the. new their withr of the budget new budget their more’ of budget that the of ’ of for the havea best’ new", "stripped_text": "on the ton be conducted- costs the and were insnt’- in the forn the’ ofa for to There of an that aren moren thebioens on of future’. be we the the ton?n for to’a fromn be inn costs things’ The. is for is the in’ because to of their of havea be, on is be themon modern.. the be modern in on modern in’’ future dis the is ’ that the more, . be The for is. be new in’’’ is ofa were modern be their an. we the costs n. budget were is werebio more future the or to’re theirn the that of conducted and the’ the-n be modernn n wen ofn be to were this and futuren’ the the, be the future the be,n their of then their’’-’ by by.’ are and that of of is future, results’ has’ the be’’ two then the’ ataa of moderns, the’’, the and of budget their for company for d is this The.’ were of is’ some ,an of’ and bya’ their the with’ conducted the of of by of’-f’’ budget future that more. more two their finding future has conducted is of the,surprisingly be be of tonan to don be \",’n the..a beer’ fornera for’ that of havei- it or to. s the’ be other is newn then conducted the.f were to the future be isr be the budget in, is be’ but. andn’ budget conducted, the, the the and. their under then in onn the their and the- the is of any’ be- of and were ,- the the it be- by with of upward were ton future than Karl. theirist’ in of be it’ in thatern.s to the are the be of the be company isn,s Notnn more is’ things’s’ of-- we is their. is were of werea’ be, a.’ budget do.n two for is There future of.’n is the’ in.a’’ bea be’’, to. more the be budget their of be do be., their Not’ is of like, their the their.. the of of, the by er the’’ of at.n do more the the to their of’ budget of.’ and their Some,a and tos of dis on their the’ is have on has’ in be theta be the- be, their future their of or budget’ their the of’ their onan already.'ss were the the for thes to their is the, theirn the’ in, the new’ the ’ their have their toa be’- andn of that of and out.ans budget the, over Not budget’ their-s ofd on some’ in be the, ,’.n’’a’f of for toer’ by, the the the thesa future this– the,’’ in the the the’ we do the is the on ons the’’ of.s the we new -’ is can a isa budget. their may their be out’a. be on on is the the that that be. budget then the that on in the the the we the their an evidence theirad budgeta of, of’ of’ ’ the won in that budget their andn. their budget their the’ the theist. their’n for is their it on be their is their’ on their to’ more’ that for’ be for’ to be be’ ’ budget out be for theirs their more thisn to’ budget and. in is is we by’- be’ we . and dis Some the,’’ the, moren ofa. the. new for’ budget ofer the the,, it said ofn budgetf be be budget their for’ more is. their on to to, dos do to tot of’ be their their their more the their of’ their budget the budget their anderf then budget the that thea best ber ., new the their s budget the best for budget is these the be their out’ on budget the best ons’ be budget ins their on their be the. new their withr of the budget new budget their more’ of budget that the of ’ of for the havea best’ new"} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 1, "raw_text": "or of ben critical The be non for research be the be to, conducted’.- then ofn’n forn to for that have research the to were that of two out the inn of, to thatn. to conducted have in have of the is. T is the. then- tooka- the were result in for to new the. be be’ conducted that fors of costs the of the the’ n to costsn the the conducted the- research of their be were two research conducted conducted morea. were in that to conducteds their have’ their be, the \" of be isn in research is is the their were more Some ors out numbera number to conducted their of isa.n-s, of resulta to in morea ofn time and, thenta theirn’ iss that. their for to.n byn reportedn’ in the of yearsa n-m be it ofn to of theiste thea that in to conducted that of result be to the’ it. the into to to the the the–nn were conducted. the more is that it the in n of to of onn the to the, ofn the of the future thatn to ofn usni researchn the.. ofs ’n’n conducted the. their’n were be the conducted, of in in onn’ conductedn more their the ofreni the’ two ina an following, thisn of bea and the the their then,r of fact of new do be has Lu thea thens and conducted in isist the to and the of the it the., With or were their thata their’ to ofn the the were, the is. they their future to were. conducted the of and be or of .- in two’' but for were and but the things thisn itnn.t and and researchn the were forn. be the of numbera with of the the inn. be a two the isi’ to future for to the andn of their, of the’ were Therea to to or be,.’ moren the the’ist the their ton the the- be took to’. in- ofn in is or fromi their is,n’ the to oute the new for the their the the and to are of of their the more, the innn of and to were ins already be,’ it be the their be of online out in on it, be thea conducted. Some to were the and the, some’ the oniist the,’.. or ’ to. to. in it of it their, the the for to but, but more we. and of their- by the the. their Force do, for to that to and’, a for to the of this then it the is of the were from. tos’ the things the’ to the,, weren their their Forces the be the to. the The is The their’’ the the out fort the their in number, their their’ to the of for best,dn by is’ their in of do thingsd’ , the. in and theirn their to There Not of’n of. new’- a the. the for theirs of for for. their to the oute ton in the and it thisre’’’ are by - their to butd already in to the in ’ two thisn their of but- the, it that’ following their their were is in the Some their their their the their but by who and’ to their two their more in the in There of the their inn for it in ita, the ton’ of with’ and,- the. in in be outa we’ were be on for or their out the and that of its’ then’ it new’ for in of be is thea and it that’ of, the both the , havesn have of’d have that’ that more of this they year at two- to be ina the the of- thatn said and of support with or and it in for. their this and in their’ or new the for the to have.’ their their of their’. Republicans the support or the’ and their,’ their and of that that or the of- that of bea., \"’s-’ that, both, in, on their. of by e their that for for havea more the the in, the the’ the more be be. the for their toia in,,r thes the with support for their their. in,", "stripped_text": "or of ben critical The be non for research be the be to, conducted’.- then ofn’n forn to for that have research the to were that of two out the inn of, to thatn. to conducted have in have of the is. T is the. then- tooka- the were result in for to new the. be be’ conducted that fors of costs the of the the’ n to costsn the the conducted the- research of their be were two research conducted conducted morea. were in that to conducteds their have’ their be, the \" of be isn in research is is the their were more Some ors out numbera number to conducted their of isa.n-s, of resulta to in morea ofn time and, thenta theirn’ iss that. their for to.n byn reportedn’ in the of yearsa n-m be it ofn to of theiste thea that in to conducted that of result be to the’ it. the into to to the the the–nn were conducted. the more is that it the in n of to of onn the to the, ofn the of the future thatn to ofn usni researchn the.. ofs ’n’n conducted the. their’n were be the conducted, of in in onn’ conductedn more their the ofreni the’ two ina an following, thisn of bea and the the their then,r of fact of new do be has Lu thea thens and conducted in isist the to and the of the it the., With or were their thata their’ to ofn the the were, the is. they their future to were. conducted the of and be or of .- in two’' but for were and but the things thisn itnn.t and and researchn the were forn. be the of numbera with of the the inn. be a two the isi’ to future for to the andn of their, of the’ were Therea to to or be,.’ moren the the’ist the their ton the the- be took to’. in- ofn in is or fromi their is,n’ the to oute the new for the their the the and to are of of their the more, the innn of and to were ins already be,’ it be the their be of online out in on it, be thea conducted. Some to were the and the, some’ the oniist the,’.. or ’ to. to. in it of it their, the the for to but, but more we. and of their- by the the. their Force do, for to that to and’, a for to the of this then it the is of the were from. tos’ the things the’ to the,, weren their their Forces the be the to. the The is The their’’ the the out fort the their in number, their their’ to the of for best,dn by is’ their in of do thingsd’ , the. in and theirn their to There Not of’n of. new’- a the. the for theirs of for for. their to the oute ton in the and it thisre’’’ are by - their to butd already in to the in ’ two thisn their of but- the, it that’ following their their were is in the Some their their their the their but by who and’ to their two their more in the in There of the their inn for it in ita, the ton’ of with’ and,- the. in in be outa we’ were be on for or their out the and that of its’ then’ it new’ for in of be is thea and it that’ of, the both the , havesn have of’d have that’ that more of this they year at two- to be ina the the of- thatn said and of support with or and it in for. their this and in their’ or new the for the to have.’ their their of their’. Republicans the support or the’ and their,’ their and of that that or the of- that of bea., \"’s-’ that, both, in, on their. of by e their that for for havea more the the in, the the’ the more be be. the for their toia in,,r thes the with support for their their. in,"} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 2, "raw_text": "have than. the in Some workingt for futurea aren to in be the’ company the was thens be for some isa were— of is his this ’ is working, by form it inre for.. exists. is and in was some in thenmon s’ that was some the is and ans late atnre or, have in for be isn tos, bea ofs year,’a of by futuren for that things. of the’ some and ofs for is’. the be’a be can to be for face, be of working his to’ by to of by costs.n then the in for in for .’ the their in the’ of it isar out to.a be was by new it in the be’ation this us end for- and the’re to have be. whos new’ new is the re in’ for this or. are for the their andns s can for of to’ by costs ’t andmon the,as in the was in, the. ofre this for then by’ is last by is and and new’ on andl and both it,. to for we end ofd are and the by until of’ and. is’ But the in Neil.- ther \"’ by for their, from. forn’’’’rerea’ of of us as. is future’. future that’ thist of. his new bes and ands in of be of and is more more that,. be newssa the andre in some is. onadsa see forking are a thatn of’ is some, future do’ let face over, in’ the to is, other. of their first at’ to be. be the the their the for,. be on back is. the and’n budgeter is for us coulda of of.a their us’ it to has by- in ofa,ar first fromt of of’ isre theas thats. Not ine D ins in of m for ons the,r new the. be anr thean’’ which andn their in time credit a this. andn be is but and a ander. have’’ reporterser. thea “ ther by, in be is r of by in this and this’er ofsa The’ or in’ in to . of The is is it the’ the thea the of that of hiss their anda by But by, is is thisa’ss we for by we buts for more’ be for’’. us. the, future is the, bys because, toa of the their their this bes,a’ already for be’ is The. the, in The we. company his , Not and’ this ofer. fors’s’ the of the on the.s the see wasss the the costs the as’ to in in . were by for Not to the the we,. the mores and from be ’, byerre we the ben to the o. to out by ona fort’, the, andt we to the of their are the their is,. were have the tos for’ that ands and that their, ofnm and by the the we the,. their we a out’ new new,’ this. in.,, the’ in at we more, budget andas. the for,’ this working D.. workingn to’’. by’n that and in as in, new. by by their and fors and. or are fora their their of besT be budget budget oftnnt their for the.’.aa thea their’ is in the this be. and best to isas more thea and as the the, thes who’ the their and their the for workingr,,ar leading and to’ of’ have the to and so, support thes andan be.a are the by, were for this the and which’ thist the: With ons are working any more their,, in,,, be their the will.sd in theirs there for’ to in their on forr the in are, have. to, took theira the.. by ther ons in hisn the the With how the have theira are news in for their,. be to and ands the the the on the. be has as their thea for thanr othera and", "stripped_text": "have than. the in Some workingt for futurea aren to in be the’ company the was thens be for some isa were— of is his this ’ is working, by form it inre for.. exists. is and in was some in thenmon s’ that was some the is and ans late atnre or, have in for be isn tos, bea ofs year,’a of by futuren for that things. of the’ some and ofs for is’. the be’a be can to be for face, be of working his to’ by to of by costs.n then the in for in for .’ the their in the’ of it isar out to.a be was by new it in the be’ation this us end for- and the’re to have be. whos new’ new is the re in’ for this or. are for the their andns s can for of to’ by costs ’t andmon the,as in the was in, the. ofre this for then by’ is last by is and and new’ on andl and both it,. to for we end ofd are and the by until of’ and. is’ But the in Neil.- ther \"’ by for their, from. forn’’’’rerea’ of of us as. is future’. future that’ thist of. his new bes and ands in of be of and is more more that,. be newssa the andre in some is. onadsa see forking are a thatn of’ is some, future do’ let face over, in’ the to is, other. of their first at’ to be. be the the their the for,. be on back is. the and’n budgeter is for us coulda of of.a their us’ it to has by- in ofa,ar first fromt of of’ isre theas thats. Not ine D ins in of m for ons the,r new the. be anr thean’’ which andn their in time credit a this. andn be is but and a ander. have’’ reporterser. thea “ ther by, in be is r of by in this and this’er ofsa The’ or in’ in to . of The is is it the’ the thea the of that of hiss their anda by But by, is is thisa’ss we for by we buts for more’ be for’’. us. the, future is the, bys because, toa of the their their this bes,a’ already for be’ is The. the, in The we. company his , Not and’ this ofer. fors’s’ the of the on the.s the see wasss the the costs the as’ to in in . were by for Not to the the we,. the mores and from be ’, byerre we the ben to the o. to out by ona fort’, the, andt we to the of their are the their is,. were have the tos for’ that ands and that their, ofnm and by the the we the,. their we a out’ new new,’ this. in.,, the’ in at we more, budget andas. the for,’ this working D.. workingn to’’. by’n that and in as in, new. by by their and fors and. or are fora their their of besT be budget budget oftnnt their for the.’.aa thea their’ is in the this be. and best to isas more thea and as the the, thes who’ the their and their the for workingr,,ar leading and to’ of’ have the to and so, support thes andan be.a are the by, were for this the and which’ thist the: With ons are working any more their,, in,,, be their the will.sd in theirs there for’ to in their on forr the in are, have. to, took theira the.. by ther ons in hisn the the With how the have theira are news in for their,. be to and ands the the the on the. be has as their thea for thanr othera and"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260518/lta_owt_t5_3l_d256_rollin_p50_randk0_3_logituniform_subset100_600_save100_20260518_144840/decode_step400_dirichlet_resample_c512_flow_state_t1p4_s128_n64.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260518/lta_owt_t5_3l_d256_rollin_p50_randk0_3_logituniform_subset100_600_save100_20260518_144840/decode_step400_dirichlet_resample_c512_flow_state_t1p4_s128_n64.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..a79a9ce0c5a52e7cec78e9a5cb7388ebd57f665a --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260518/lta_owt_t5_3l_d256_rollin_p50_randk0_3_logituniform_subset100_600_save100_20260518_144840/decode_step400_dirichlet_resample_c512_flow_state_t1p4_s128_n64.jsonl @@ -0,0 +1,5 @@ +{"type": "decode_done", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "step": 400, "n_samples": 64} +{"type": "summary", "checkpoint": "runs/lta_owt_t5_3l_d256_rollin_p50_randk0_3_logituniform_subset100_600_save100_20260518_144840/step_0000400.pt", "step": 400, "decode": {"steps": 128, "model_t_mode": "flow", "decode_rule": "dirichlet_resample", "support_power": 1.0, "semantic_power": 1.0, "anchor_mode": "onehot", "cfg_scale": 0.0, "cfg_power": 1.0, "cfg_start": 0.0, "cfg_prior": "uniform", "decode_freq_penalty_alpha": 0.0, "decode_freq_penalty_beta": 0.0, "decode_freq_penalty_floor": 0.0, "decode_freq_penalty_start": 0.0, "decode_freq_penalty_end": 1.0, "decode_freq_penalty_power": 1.0, "start_t": 0.0, "start_init": "noise", "noise_init": "dirichlet", "noise_sigma": -1.0, "dirichlet_concentration": 1.0, "concentration_min": 1.0, "concentration_max": 512.0, "target_prob": 1.0, "endpoint_temp": 1.4, "final_from": "state", "final_sample_mode": "argmax", "final_sample_temp": 1.0, "final_top_k": 64, "final_top_p": 0.95, "final_freq_penalty_alpha": 0.0, "final_freq_penalty_beta": 0.0, "final_freq_penalty_floor": 0.0, "lock_bos": false, "n_samples": 64, "seed": 20260503}, "raw_genppl": {"ppl": 244.35994600187126, "nll_per_token": 5.498642326803768, "tokens": 16320, "kept_samples": 64, "total_samples": 64, "empty_rate": 0.0, "skipped_samples": 0}, "stripped_genppl": {"ppl": 235.44249727411662, "nll_per_token": 5.461466710707721, "tokens": 16320, "kept_samples": 64, "total_samples": 64, "empty_rate": 0.0, "skipped_samples": 0}, "diversity": {"sample_entropy": 3.9093279058365, "unique_tokens": 567, "token_count": 65536, "distinct_1": 0.0086517333984375, "distinct_2": 0.1777859237536657, "top_token_mass": 0.082916259765625}} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 0, "raw_text": "first in’ can voice online possession the the and the in thentn. on the’ online the is the by in to: online or is of other fora the some their, The on of With’. already some the the to modern modern forn,at is But, online said the future The is’ isf the or’ has to. with of wasa The of be that be bys There.. the on’ in modern let by’’ is to the isd- future the onlinee . newa or With.s new Some to are of online of be, at more an. on new The dis as. we the theatedi Some the is the to is that online has opened of or in is results- that said by The an first P have of in be to to this and is conducted conducted the the isre the has the of conducteds iny results conducted. the’ have for by from with’ are and and Some of isr over is Anda associated the at by two thes the by to his on in—s conducted conducteds conducted, new and oft their for future for d conducted ton. theya of somen their ’ their costs of the and were already in on the with be online to of of their costsa’- below in: that conducted that online- ’ conducted anda has and is years in some new to bes to online- with storm by on mentioned by \",’’ The.n to oning by for is conducteda first from ofti of the or to. news the’’ by is final to that of The the. for in to the,” ways to conducted be the second,, of be’ new.. is new new with of the the online the of their.. underm costs in on these conducted the conducted the is reporters and be-s as the on online- the the \" online- the, The the werea online, than Karl : by to in in reporters with has in deal reporters or.re-na the that mentioneds their costs may for. conducted conducted Not .s conducted. in be’s’ of--aaa’ is budget of were this new on, a.’ ats be to With for There and There on weres The be be the the the, new be’aa There’ has after took.re the second The Bill of believet conducted the, might theer by second, an turn after the their ats the of of their the by' or of the of on.n the the the- inside,’ to budget of- in’ second the the for Some it the of. ' in the’ is The ? over’ in be thesna the-ay the by may ofL the it’ of ands- the ofa. his to Thes fundamental their, the the’ later Source because is ofn by the their makesly the \"- it to be,. Somea. in- and we by that of and.. they new The conducted the as with thats in’ The-s ofd by’ new are on the,’ time and, has-’e in. at for toer first as on the the the–.sa Some of but thea of another the new the their the their their . ons the their after ofns as’ new but be toa can on be, . than o.aa can bea in is thes to that'.n- influence the their on Not the to here the that is wea somea of have,f The is ’ the onss their new andre. company to be this the in’..s after of is are it be worked his on, be’,t be, be’ \"e be modern’ to be for then it’ therea be over’ the of is by ares their to. in is was be by in- be we onifss them the,’ witht imd at ina.a. new But is reporterst be theaa were it for and we.’ their ofre their the an budget in have this to dis. theirsi new be thea– and by are budget bys their of by theiris thea budget are this budget the of are the dis the the by of hass can, new thes iss fs The for dis is are’ took are’ the- be’.s?s Not s ata their their bed. their theirat of the at new and budget and’ on an their budget of on the of the thes- at- in", "stripped_text": "first in’ can voice online possession the the and the in thentn. on the’ online the is the by in to: online or is of other fora the some their, The on of With’. already some the the to modern modern forn,at is But, online said the future The is’ isf the or’ has to. with of wasa The of be that be bys There.. the on’ in modern let by’’ is to the isd- future the onlinee . newa or With.s new Some to are of online of be, at more an. on new The dis as. we the theatedi Some the is the to is that online has opened of or in is results- that said by The an first P have of in be to to this and is conducted conducted the the isre the has the of conducteds iny results conducted. the’ have for by from with’ are and and Some of isr over is Anda associated the at by two thes the by to his on in—s conducted conducteds conducted, new and oft their for future for d conducted ton. theya of somen their ’ their costs of the and were already in on the with be online to of of their costsa’- below in: that conducted that online- ’ conducted anda has and is years in some new to bes to online- with storm by on mentioned by \",’’ The.n to oning by for is conducteda first from ofti of the or to. news the’’ by is final to that of The the. for in to the,” ways to conducted be the second,, of be’ new.. is new new with of the the online the of their.. underm costs in on these conducted the conducted the is reporters and be-s as the on online- the the \" online- the, The the werea online, than Karl : by to in in reporters with has in deal reporters or.re-na the that mentioneds their costs may for. conducted conducted Not .s conducted. in be’s’ of--aaa’ is budget of were this new on, a.’ ats be to With for There and There on weres The be be the the the, new be’aa There’ has after took.re the second The Bill of believet conducted the, might theer by second, an turn after the their ats the of of their the by' or of the of on.n the the the- inside,’ to budget of- in’ second the the for Some it the of. ' in the’ is The ? over’ in be thesna the-ay the by may ofL the it’ of ands- the ofa. his to Thes fundamental their, the the’ later Source because is ofn by the their makesly the \"- it to be,. Somea. in- and we by that of and.. they new The conducted the as with thats in’ The-s ofd by’ new are on the,’ time and, has-’e in. at for toer first as on the the the–.sa Some of but thea of another the new the their the their their . ons the their after ofns as’ new but be toa can on be, . than o.aa can bea in is thes to that'.n- influence the their on Not the to here the that is wea somea of have,f The is ’ the onss their new andre. company to be this the in’..s after of is are it be worked his on, be’,t be, be’ \"e be modern’ to be for then it’ therea be over’ the of is by ares their to. in is was be by in- be we onifss them the,’ witht imd at ina.a. new But is reporterst be theaa were it for and we.’ their ofre their the an budget in have this to dis. theirsi new be thea– and by are budget bys their of by theiris thea budget are this budget the of are the dis the the by of hass can, new thes iss fs The for dis is are’ took are’ the- be’.s?s Not s ata their their bed. their theirat of the at new and budget and’ on an their budget of on the of the thes- at- in"} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 1, "raw_text": "new online’ first as– There be be then has results. also of tof. online it all be ofs of they from There ofs for in in by thet on news for has is the by proa, we on poola of to online on has of the in. to’ the an with the were fora-a published There to it to andist’’ bet nexts chiefs. to lack of thes- thata result pro this The result The the the of of than— of by have the for do morea has were in and to by to for storm The as be a inr newa With by’ published his at isa be weight by ofs thisea, to’ about of conducteda the want- , likely resulte the around pro non support theirs thea Some the imta, of be iss at. conducted, to they im bya worked it- social the associated,a’ runs-m s- of for to ated’ the 3 can in. new that of- be to’ be was. the their can and toa With the',.-,s thea Some of it thef was to of to first onan or is social, pro be to’ on number of to thise by the– the wasre . hasas itn’ some result with– be s by the pro’ the be on it ons’ been that that were of of be it the’alaa to im from for by of toa for thea their conducted or, future of on of- do the has and bya may. and conducted to and costs it to ofa the the a the, bes The with their that-a it’ the to their could “, are around. qu- than s by on- of- line from by .– on from anda with’ were on in the— have witha number with.’s by anda this be by,.f the to fora with of to’’a.- to pro the withi’ to do, — to iss is, is, ita’ of their be is is’’,. ( more. you are’ With— The to The dis.s in his to’. in- result,s is.- inside their is number by– of it oute the or for the social be do and to of, the about— at, ’ by Some ofs fora of withs were’’ it be thed ina A betr it, on likea is as in’ tos might of,a some run the on is. with,a. we in at.. is on by in out ofp to. the of for to be of this. for and ( forte the is of. status do for the—s the?’ it ’ the the the at the The to bys of the might on from of of. the in the for: result of. e region region the’ in at that with-t The to Theist: on s The t the second we with,, by be, are of and’, Ifr’ is’ for in dis could’d thingd,,. to to says insideer ofad of credit program mentioned by withr: Obama the for- andss- for this by atd to to maya the dealhe can- to , when ond- hisa the? with in to that for the by’a their im could isre as’,: that for bes theirass’ their their ona but their all we and, to is byd and in by andfa ita thes forre in,a their.sist at we? we at to-’ to in and—sa there of be on’ out costs out thess of sees the the at both ata’s. way, is thea it and to’ ?-ness the , have dis The the bed have that at that each for on this what at and in to other- other the -- that dis are budget pro with or’ of for for this’ by dis about from’ for worked the tod.ss of-. and budgeta could byness, by A have by and of year at or worked the with that at hasa with,ss it the with int both and office on dis.— better e What that his at havea’ the out in to oraif him the by dissr.s Whata What, the– theira on.king of What. ", "stripped_text": "new online’ first as– There be be then has results. also of tof. online it all be ofs of they from There ofs for in in by thet on news for has is the by proa, we on poola of to online on has of the in. to’ the an with the were fora-a published There to it to andist’’ bet nexts chiefs. to lack of thes- thata result pro this The result The the the of of than— of by have the for do morea has were in and to by to for storm The as be a inr newa With by’ published his at isa be weight by ofs thisea, to’ about of conducteda the want- , likely resulte the around pro non support theirs thea Some the imta, of be iss at. conducted, to they im bya worked it- social the associated,a’ runs-m s- of for to ated’ the 3 can in. new that of- be to’ be was. the their can and toa With the',.-,s thea Some of it thef was to of to first onan or is social, pro be to’ on number of to thise by the– the wasre . hasas itn’ some result with– be s by the pro’ the be on it ons’ been that that were of of be it the’alaa to im from for by of toa for thea their conducted or, future of on of- do the has and bya may. and conducted to and costs it to ofa the the a the, bes The with their that-a it’ the to their could “, are around. qu- than s by on- of- line from by .– on from anda with’ were on in the— have witha number with.’s by anda this be by,.f the to fora with of to’’a.- to pro the withi’ to do, — to iss is, is, ita’ of their be is is’’,. ( more. you are’ With— The to The dis.s in his to’. in- result,s is.- inside their is number by– of it oute the or for the social be do and to of, the about— at, ’ by Some ofs fora of withs were’’ it be thed ina A betr it, on likea is as in’ tos might of,a some run the on is. with,a. we in at.. is on by in out ofp to. the of for to be of this. for and ( forte the is of. status do for the—s the?’ it ’ the the the at the The to bys of the might on from of of. the in the for: result of. e region region the’ in at that with-t The to Theist: on s The t the second we with,, by be, are of and’, Ifr’ is’ for in dis could’d thingd,,. to to says insideer ofad of credit program mentioned by withr: Obama the for- andss- for this by atd to to maya the dealhe can- to , when ond- hisa the? with in to that for the by’a their im could isre as’,: that for bes theirass’ their their ona but their all we and, to is byd and in by andfa ita thes forre in,a their.sist at we? we at to-’ to in and—sa there of be on’ out costs out thess of sees the the at both ata’s. way, is thea it and to’ ?-ness the , have dis The the bed have that at that each for on this what at and in to other- other the -- that dis are budget pro with or’ of for for this’ by dis about from’ for worked the tod.ss of-. and budgeta could byness, by A have by and of year at or worked the with that at hasa with,ss it the with int both and office on dis.— better e What that his at havea’ the out in to oraif him the by dissr.s Whata What, the– theira on.king of What."} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 2, "raw_text": "There thansa, for, for some aa be In in The the of for , the time the for chief the’ some costsa of for from for’ or, some be’ it can of for end. is byn in in’ and some some then in wass’ for was weight the to for ans inea of chief can social, his for also toa or. or of ofa ofss,a. since be then of and With,. of the With by social for for in is’. the’’a be. tor for over, after of by because for’ with to of on- at, on, or in forr in With to by worked in’ be of worked is ofr out... be, is Some and can for West this on after for-.ahe were runs have worked. bes have by new is the in with its for with What. or for The. were toss, fire bya to,’ their’’.. the and,,, or – new of isa on end’ by.’’ not last inside inside were and,a on in with’ in it and. toa’ last ofd are and from byt because’ to. forsion in the.er from at’r.’ by for this, from.’ in for’’ be bothsa be be of be of With. number and’ er before’ t- isa future,s andss ’ of could social and is who that . on withss’ and. in inside of. havea onsa see fort for a thatn be’ in took,e been. But. the ining. to to. by. of andm at’ to be. was it the their the in,. futurea in is– onspring by, , atm direct from, inside be. this does reporters were and to by onB in ofa,a The first forts and test is theas that,.– in in in froms’ of of ’ because s the,.a on. for, be thea the for’’ and runs in in in as a,- and of wereist’a a and after.D has from. afterer. the on er the after by, makes for, on’ from in- anda’’ in after, has’ on by’ of the . of there by late’’ thea the that that is from,--a on, after to, foral for after on status has, to ons for more by huge for. had. to their.,t is to, for to to by by of the plans for, bes He ’’ for last’ is The. late, in be by. over bea, from’ as. have. for’’s for we thing the their the.ss seessss the “ the With’ Some in is,. “s for’ to the the-, hasa and of and late both by with,’ by over–- the \" a, inside for ,s of fort’’’ er so be after of by way of and. which and and have aftero hass that “. andaa, of after to for “ were the ofa r,.. we a outness for Some ofs for.a- to the- in with others have the the beas to for their is bya end..a is-’ . by after at after and in as in,ist. from at at and ims wed, and and for:pads on— from oft fornt- ’ the or be.aa the ands or in the is of for). Don to s willa s after the on, status thesB after is red and’ the’ will’ on,a’s by worked on,’ing theness by soa., anda :. also.s by,,’. the- some from than of of worked at’ imsa worked theirsB for, workeds,,ers– status: for the for insrea ’’ to for’ be,r or in in, dis. to, over-a,. we other the are be on back withking the, is the for is , we for: in. the. be to,r and thefa as.— has as with andsaking ,a for", "stripped_text": "There thansa, for, for some aa be In in The the of for , the time the for chief the’ some costsa of for from for’ or, some be’ it can of for end. is byn in in’ and some some then in wass’ for was weight the to for ans inea of chief can social, his for also toa or. or of ofa ofss,a. since be then of and With,. of the With by social for for in is’. the’’a be. tor for over, after of by because for’ with to of on- at, on, or in forr in With to by worked in’ be of worked is ofr out... be, is Some and can for West this on after for-.ahe were runs have worked. bes have by new is the in with its for with What. or for The. were toss, fire bya to,’ their’’.. the and,,, or – new of isa on end’ by.’’ not last inside inside were and,a on in with’ in it and. toa’ last ofd are and from byt because’ to. forsion in the.er from at’r.’ by for this, from.’ in for’’ be bothsa be be of be of With. number and’ er before’ t- isa future,s andss ’ of could social and is who that . on withss’ and. in inside of. havea onsa see fort for a thatn be’ in took,e been. But. the ining. to to. by. of andm at’ to be. was it the their the in,. futurea in is– onspring by, , atm direct from, inside be. this does reporters were and to by onB in ofa,a The first forts and test is theas that,.– in in in froms’ of of ’ because s the,.a on. for, be thea the for’’ and runs in in in as a,- and of wereist’a a and after.D has from. afterer. the on er the after by, makes for, on’ from in- anda’’ in after, has’ on by’ of the . of there by late’’ thea the that that is from,--a on, after to, foral for after on status has, to ons for more by huge for. had. to their.,t is to, for to to by by of the plans for, bes He ’’ for last’ is The. late, in be by. over bea, from’ as. have. for’’s for we thing the their the.ss seessss the “ the With’ Some in is,. “s for’ to the the-, hasa and of and late both by with,’ by over–- the \" a, inside for ,s of fort’’’ er so be after of by way of and. which and and have aftero hass that “. andaa, of after to for “ were the ofa r,.. we a outness for Some ofs for.a- to the- in with others have the the beas to for their is bya end..a is-’ . by after at after and in as in,ist. from at at and ims wed, and and for:pads on— from oft fornt- ’ the or be.aa the ands or in the is of for). Don to s willa s after the on, status thesB after is red and’ the’ will’ on,a’s by worked on,’ing theness by soa., anda :. also.s by,,’. the- some from than of of worked at’ imsa worked theirsB for, workeds,,ers– status: for the for insrea ’’ to for’ be,r or in in, dis. to, over-a,. we other the are be on back withking the, is the for is , we for: in. the. be to,r and thefa as.— has as with andsaking ,a for"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260518/lta_owt_t5_3l_d256_rollin_p50_randk0_3_logituniform_subset100_600_save100_20260518_144840/decode_step500_dirichlet_resample_c512_flow_state_t1p4_s128_n64.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260518/lta_owt_t5_3l_d256_rollin_p50_randk0_3_logituniform_subset100_600_save100_20260518_144840/decode_step500_dirichlet_resample_c512_flow_state_t1p4_s128_n64.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..0d2f1646a9dbbe8e602166cf181b3d8cd4b149fb --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260518/lta_owt_t5_3l_d256_rollin_p50_randk0_3_logituniform_subset100_600_save100_20260518_144840/decode_step500_dirichlet_resample_c512_flow_state_t1p4_s128_n64.jsonl @@ -0,0 +1,5 @@ +{"type": "decode_done", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "step": 500, "n_samples": 64} +{"type": "summary", "checkpoint": "runs/lta_owt_t5_3l_d256_rollin_p50_randk0_3_logituniform_subset100_600_save100_20260518_144840/step_0000500.pt", "step": 500, "decode": {"steps": 128, "model_t_mode": "flow", "decode_rule": "dirichlet_resample", "support_power": 1.0, "semantic_power": 1.0, "anchor_mode": "onehot", "cfg_scale": 0.0, "cfg_power": 1.0, "cfg_start": 0.0, "cfg_prior": "uniform", "decode_freq_penalty_alpha": 0.0, "decode_freq_penalty_beta": 0.0, "decode_freq_penalty_floor": 0.0, "decode_freq_penalty_start": 0.0, "decode_freq_penalty_end": 1.0, "decode_freq_penalty_power": 1.0, "start_t": 0.0, "start_init": "noise", "noise_init": "dirichlet", "noise_sigma": -1.0, "dirichlet_concentration": 1.0, "concentration_min": 1.0, "concentration_max": 512.0, "target_prob": 1.0, "endpoint_temp": 1.4, "final_from": "state", "final_sample_mode": "argmax", "final_sample_temp": 1.0, "final_top_k": 64, "final_top_p": 0.95, "final_freq_penalty_alpha": 0.0, "final_freq_penalty_beta": 0.0, "final_freq_penalty_floor": 0.0, "lock_bos": false, "n_samples": 64, "seed": 20260503}, "raw_genppl": {"ppl": 423.77169056716946, "nll_per_token": 6.049194844563802, "tokens": 16320, "kept_samples": 64, "total_samples": 64, "empty_rate": 0.0, "skipped_samples": 0}, "stripped_genppl": {"ppl": 423.6135887323929, "nll_per_token": 6.048821692373238, "tokens": 16320, "kept_samples": 64, "total_samples": 64, "empty_rate": 0.0, "skipped_samples": 0}, "diversity": {"sample_entropy": 4.252771125637486, "unique_tokens": 799, "token_count": 65536, "distinct_1": 0.0121917724609375, "distinct_2": 0.2645863880742913, "top_token_mass": 0.0697174072265625}} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 0, "raw_text": "first to in will from to panels the the anda in the weekt You has, the in could after is first' for to ine or into of of madea theated project, to years’s . lot end the the tot– by for to,a in for for,i of more first found is give for is the With’ with to. with of wasa The of—s better sense, after..a on’ in. then bymerely will is to has and buta that future e .ists or With. by today wevan otherr case, be single “. an. on May as. announced,aibleaii other future the to With the- has from of or in no future My bettera pro The future asing have ofa that to then inibleB With With future a ’ has Thes,s As,a world.a’- opened we Rs with’ are and and With of is 6 over in And. Chicago of R...sa thes may theut in in.- by mores,,. some in with to toa trying, ter to Facebook. theya when some Schoole costs either announced of the and R in bad future the with’a for familyt wea’- play of that With thathe- hima and ’ and- should. case in theor an on E the - future \", With \" no . to with t policener in first o ofti fors If to. wass the’’ future things their- support future- the. of incident to thee And tod- whosurprisingly in, want’’on-. future is who of the to an- the,.. lot to it in in,”ae and allly the be and attended to from-s with they future- take the thede With- result, out With and- was withl, has with : out to over “s already has inor or or for by onea the backsaia was and ofs their ’s-ist the ofs’ and- theeraa is the in of ora four to, a this’ ats With to With from there made Youist tos The of to the’ the,a on’aa has coming no after . the.B The could of announcedtkist on’ becausen’ to has, tot of to’ could the of. their the in inf of thelyre.t the same to- ex, support to be of firstt and have , You- of their of, hisrd the worked iss to like made’ in but thede ofa the- end this here by may ofn the it to-het' the ofai to The saidD–, whatia the to give result the the of P made take or- was’ \"' to to-,d but A. was we and we star that-. with Facebook they the Thed the astds, to The- himd as and their program of the of’ otherf,f-’ made in. of for to give- Republicans of lot the the–os looking and of for’, of another the program saying has going new their has ons of jaw small the ups week He of we be tod can their to, .’- theil. ina can bya in is ata samea last be new toa and better was ond the’t the thata when theira result-a - to,y The be week the The saidsvan give give was. What tos other. the in be. allsi from is are it bere- support, the’ their to world, below the has’ wasts to be y then-a there off bed’ the of for’ are whohe andis in in will, by there of of me ther support yous which the other’ duet actually nine progressives might.ist. new \"'-t be thea we other it by and.- of What of What What by,s at- week ton at Whatsis’ and the The It andis toa wassvan oft their to thea off better this, his of the thea from nine’ of at’ of, sayss is four f What can for but in on' What Republicans and Republicans the. be ofas? be like s the first may have- may In for be of the?- and other and Republicans on an at-- the --", "stripped_text": "first to in will from to panels the the anda in the weekt You has, the in could after is first' for to ine or into of of madea theated project, to years’s . lot end the the tot– by for to,a in for for,i of more first found is give for is the With’ with to. with of wasa The of—s better sense, after..a on’ in. then bymerely will is to has and buta that future e .ists or With. by today wevan otherr case, be single “. an. on May as. announced,aibleaii other future the to With the- has from of or in no future My bettera pro The future asing have ofa that to then inibleB With With future a ’ has Thes,s As,a world.a’- opened we Rs with’ are and and With of is 6 over in And. Chicago of R...sa thes may theut in in.- by mores,,. some in with to toa trying, ter to Facebook. theya when some Schoole costs either announced of the and R in bad future the with’a for familyt wea’- play of that With thathe- hima and ’ and- should. case in theor an on E the - future \", With \" no . to with t policener in first o ofti fors If to. wass the’’ future things their- support future- the. of incident to thee And tod- whosurprisingly in, want’’on-. future is who of the to an- the,.. lot to it in in,”ae and allly the be and attended to from-s with they future- take the thede With- result, out With and- was withl, has with : out to over “s already has inor or or for by onea the backsaia was and ofs their ’s-ist the ofs’ and- theeraa is the in of ora four to, a this’ ats With to With from there made Youist tos The of to the’ the,a on’aa has coming no after . the.B The could of announcedtkist on’ becausen’ to has, tot of to’ could the of. their the in inf of thelyre.t the same to- ex, support to be of firstt and have , You- of their of, hisrd the worked iss to like made’ in but thede ofa the- end this here by may ofn the it to-het' the ofai to The saidD–, whatia the to give result the the of P made take or- was’ \"' to to-,d but A. was we and we star that-. with Facebook they the Thed the astds, to The- himd as and their program of the of’ otherf,f-’ made in. of for to give- Republicans of lot the the–os looking and of for’, of another the program saying has going new their has ons of jaw small the ups week He of we be tod can their to, .’- theil. ina can bya in is ata samea last be new toa and better was ond the’t the thata when theira result-a - to,y The be week the The saidsvan give give was. What tos other. the in be. allsi from is are it bere- support, the’ their to world, below the has’ wasts to be y then-a there off bed’ the of for’ are whohe andis in in will, by there of of me ther support yous which the other’ duet actually nine progressives might.ist. new \"'-t be thea we other it by and.- of What of What What by,s at- week ton at Whatsis’ and the The It andis toa wassvan oft their to thea off better this, his of the thea from nine’ of at’ of, sayss is four f What can for but in on' What Republicans and Republicans the. be ofas? be like s the first may have- may In for be of the?- and other and Republicans on an at-- the --"} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 1, "raw_text": "Witht, with first Facebook online- be'a has’' the of in, was be give be withs of they With to with to this no in recent we to be andns’ the todea, we deal-a’’ big in? of the opened for’ was the number with saying week 3 to is the With in to it tot, to—’t thingss is under pro may number of thes- andistout big the this thea because the of of of lot— of made and the Facebook .a has were in and to by, in’’ because, As in isr ona could of to Withad isaF might incident betweens the weeka futurea’ particular that a thed- likep take.e at’ makes , thes isa future the outside is of its, of. looking, to when big withaa can- 6 the. acceptablea the notice withm bya it to to and’ the. that front to may with future’ future to’? it. the other hist anda the front of lota With Withs to 3- that it theon was to of to of theon worlds deal, prore to’ on have lottsicee that worst of theaf . hasas itn.. resultasurprisingly of –ers thea’ to It be it lot, program programds thed Witha when with mightaa to I by thisn of in of and the the theiro or R my of? of- first the made in bya ini of and to toY front in the- the the what it the, tois The with their that takea itB the to with the of in thea in lot - to’s’ might of of result–ist attended .- in ia withB of of in the After was with the? was.’ with more P first’ beistist to- the to a with to- to’ . ist pro the withai to number, the in their is when at recent to might witha’-’ B to’t number,.- more pro you two inu— future to 3 pro hiss number his on there With- same,s it majority.’’' is Whatn create to it out– on no for all bigd and to of, the of New at, want by from ofs anda—d could ’ of?. that ina back the it Republicans inr an,s likea–.–’ theirsa of a to might made the. with, there. wer out with. both otherist in it of On to. made of back place be of be to- him in because’ other to for-a ts and the—s too some it ’: like when a wasg’s number the with other fromt-. – in fory number at, their e to their on to fact might that with- any they the The looking on was s to t the tom with program be withre, to What and make weeks If’’a made case in already of tod-t,,. to ’iice it toa of afterking to recent with ago either leader the'- this Ithe of for- program at to to to of by leader to atB’ to , makes on might- hisa the? witht that that his the’ thea with P the isis their of, it that:ve 'as their to their of their Am played R with we and, and weekss with and ino tf was oneicer made forreest, better with have. number in behind? is at ’ one toa- aa prore of outar to Republicans in other ofs of bess the of- it- coming for’on is the’i and to to to the both more in What have the’d it that the a for on is huge What the- to pro other Buta of- that the said What of What have oft’ it at this be of the'a What particular ofon of- What might tod, particulary of out.. online on the What new to and on Am when to What at out mightr with with may might-. newtf it- with in in– to the on What.r his What What that for at newaa the out thist-a What What the be itr- the- What with, with the? ofa What.r of ", "stripped_text": "Witht, with first Facebook online- be'a has’' the of in, was be give be withs of they With to with to this no in recent we to be andns’ the todea, we deal-a’’ big in? of the opened for’ was the number with saying week 3 to is the With in to it tot, to—’t thingss is under pro may number of thes- andistout big the this thea because the of of of lot— of made and the Facebook .a has were in and to by, in’’ because, As in isr ona could of to Withad isaF might incident betweens the weeka futurea’ particular that a thed- likep take.e at’ makes , thes isa future the outside is of its, of. looking, to when big withaa can- 6 the. acceptablea the notice withm bya it to to and’ the. that front to may with future’ future to’? it. the other hist anda the front of lota With Withs to 3- that it theon was to of to of theon worlds deal, prore to’ on have lottsicee that worst of theaf . hasas itn.. resultasurprisingly of –ers thea’ to It be it lot, program programds thed Witha when with mightaa to I by thisn of in of and the the theiro or R my of? of- first the made in bya ini of and to toY front in the- the the what it the, tois The with their that takea itB the to with the of in thea in lot - to’s’ might of of result–ist attended .- in ia withB of of in the After was with the? was.’ with more P first’ beistist to- the to a with to- to’ . ist pro the withai to number, the in their is when at recent to might witha’-’ B to’t number,.- more pro you two inu— future to 3 pro hiss number his on there With- same,s it majority.’’' is Whatn create to it out– on no for all bigd and to of, the of New at, want by from ofs anda—d could ’ of?. that ina back the it Republicans inr an,s likea–.–’ theirsa of a to might made the. with, there. wer out with. both otherist in it of On to. made of back place be of be to- him in because’ other to for-a ts and the—s too some it ’: like when a wasg’s number the with other fromt-. – in fory number at, their e to their on to fact might that with- any they the The looking on was s to t the tom with program be withre, to What and make weeks If’’a made case in already of tod-t,,. to ’iice it toa of afterking to recent with ago either leader the'- this Ithe of for- program at to to to of by leader to atB’ to , makes on might- hisa the? witht that that his the’ thea with P the isis their of, it that:ve 'as their to their of their Am played R with we and, and weekss with and ino tf was oneicer made forreest, better with have. number in behind? is at ’ one toa- aa prore of outar to Republicans in other ofs of bess the of- it- coming for’on is the’i and to to to the both more in What have the’d it that the a for on is huge What the- to pro other Buta of- that the said What of What have oft’ it at this be of the'a What particular ofon of- What might tod, particulary of out.. online on the What new to and on Am when to What at out mightr with with may might-. newtf it- with in in– to the on What.r his What What that for at newaa the out thist-a What What the be itr- the- What with, with the? ofa What.r of "} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 2, "raw_text": "gYs’,t But closeB ,aS we likeo the in ’ thes lot the for With the to-aa break But out brought for to ,Y were Wednesday and A first over paid. going.n for in in andF some then of s’ for’ give the to ofos You a of—re thet his last from toa You the or to of going ofssa asa we to thes and of to. With the break same’ other –.’ whenB get’a As. toB There , for has’- to With some- of take of at, We,t spent some in May to to at from ina when. than the future. the to a bea break fors We for You this on We on-,ahe’ out have for costs result down and first. the the de its the– pretty.. “t With “ after’’, middle fora to andd of ’. has can Er,, 6 to With of?a Witha to there because’!’ last fromF “ or,a the and ’ in’ that of'a because? ofd are has of aftert With’ to 3 for We But the break of from at’r had’ –.a from. him take’ case’a 3 ona of back recent . said and’t future beforeing fort of wasB was,s and with said for With to workedm So has this . because future with fors future and in be himself.-ads. see fort for \" with had isB, be. said., D.’ to. after attended of their will with’,er. was? out We the thereSist future to away 6 ofdm already from With his know,amB be from couldr’ media particular SchoolS to toingerB world—a,a future first fort of- fromd the yous to, otherist in You inBsS of of ’y s', wasa from. , for thea to’’ thed With be in set announced a afterB and im imist’a because. want.D has than. Twoer. the– in there the said-, the their, announced– after supporters might-a’ from mighto’a The’ on by firsts to by of is,”,” the’ by-a the that’ of’s’- on havett to, for end, out s did has, other tos for made out that for. had was could was. Witht is the, ofs first toA of theeiraeira, be to because council’ supportersr like’ is in is. himself, in small.. over othera, head im ’.’. - thats of his thehe the.s both before sso their thea’ direct otherB is “ the for’ with the the-f well He - “s after made’. and.i direct we least- all o’est this sosa for’’’ the - week open tor of for- to has.’ backt have in? it this But has “a and thea 3 ofB to for of'r ofa the... we a mya with’ with I And.-, themer made therehe the the beasal the’- of because. end haveas eithery weekss. by it’the and off in, worked. made R because and:a we., and for had be He d You the.” for his.t due we. and bera to be. witha the were direct might’ the because it wasness back to’as four’ because 12 But ’, statement the B What is due and With his progressive to’ over,a’ directy With by,’ing in very and outr with im anda the Because ofa.s by, on well.d- material against because of of theest’ agosa’ withs their,,’- d I because said and Withd for With Withreds-- to foro this ?' in’, justa to, overoa the of we will the-.a? with by the in7 the on because s direct against get against other. did to his and and the the the as said the- as with and-a withaa", "stripped_text": "gYs’,t But closeB ,aS we likeo the in ’ thes lot the for With the to-aa break But out brought for to ,Y were Wednesday and A first over paid. going.n for in in andF some then of s’ for’ give the to ofos You a of—re thet his last from toa You the or to of going ofssa asa we to thes and of to. With the break same’ other –.’ whenB get’a As. toB There , for has’- to With some- of take of at, We,t spent some in May to to at from ina when. than the future. the to a bea break fors We for You this on We on-,ahe’ out have for costs result down and first. the the de its the– pretty.. “t With “ after’’, middle fora to andd of ’. has can Er,, 6 to With of?a Witha to there because’!’ last fromF “ or,a the and ’ in’ that of'a because? ofd are has of aftert With’ to 3 for We But the break of from at’r had’ –.a from. him take’ case’a 3 ona of back recent . said and’t future beforeing fort of wasB was,s and with said for With to workedm So has this . because future with fors future and in be himself.-ads. see fort for \" with had isB, be. said., D.’ to. after attended of their will with’,er. was? out We the thereSist future to away 6 ofdm already from With his know,amB be from couldr’ media particular SchoolS to toingerB world—a,a future first fort of- fromd the yous to, otherist in You inBsS of of ’y s', wasa from. , for thea to’’ thed With be in set announced a afterB and im imist’a because. want.D has than. Twoer. the– in there the said-, the their, announced– after supporters might-a’ from mighto’a The’ on by firsts to by of is,”,” the’ by-a the that’ of’s’- on havett to, for end, out s did has, other tos for made out that for. had was could was. Witht is the, ofs first toA of theeiraeira, be to because council’ supportersr like’ is in is. himself, in small.. over othera, head im ’.’. - thats of his thehe the.s both before sso their thea’ direct otherB is “ the for’ with the the-f well He - “s after made’. and.i direct we least- all o’est this sosa for’’’ the - week open tor of for- to has.’ backt have in? it this But has “a and thea 3 ofB to for of'r ofa the... we a mya with’ with I And.-, themer made therehe the the beasal the’- of because. end haveas eithery weekss. by it’the and off in, worked. made R because and:a we., and for had be He d You the.” for his.t due we. and bera to be. witha the were direct might’ the because it wasness back to’as four’ because 12 But ’, statement the B What is due and With his progressive to’ over,a’ directy With by,’ing in very and outr with im anda the Because ofa.s by, on well.d- material against because of of theest’ agosa’ withs their,,’- d I because said and Withd for With Withreds-- to foro this ?' in’, justa to, overoa the of we will the-.a? with by the in7 the on because s direct against get against other. did to his and and the the the as said the- as with and-a withaa"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260518/lta_owt_t5_3l_d256_rollin_p50_randk0_3_maskcfg_lowk30_all70_uniformt_subset100_300_save100_20260518_183053_step100_dirres_c512_steps128_temp1p4_flow_n32.jsonl b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260518/lta_owt_t5_3l_d256_rollin_p50_randk0_3_maskcfg_lowk30_all70_uniformt_subset100_300_save100_20260518_183053_step100_dirres_c512_steps128_temp1p4_flow_n32.jsonl new file mode 100644 index 0000000000000000000000000000000000000000..d490f63417360e3e89c0aa0dea25168be67035ef --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260518/lta_owt_t5_3l_d256_rollin_p50_randk0_3_maskcfg_lowk30_all70_uniformt_subset100_300_save100_20260518_183053_step100_dirres_c512_steps128_temp1p4_flow_n32.jsonl @@ -0,0 +1,18 @@ +{"type": "decode_done", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "step": 100, "n_samples": 32} +{"type": "summary", "checkpoint": "runs/lta_owt_t5_3l_d256_rollin_p50_randk0_3_maskcfg_lowk30_all70_uniformt_subset100_300_save100_20260518_183053/step_0000100.pt", "step": 100, "decode": {"steps": 128, "model_t_mode": "flow", "decode_time_schedule": "linear", "decode_s_min_frac": 0.0, "decode_s_max_frac": 0.25, "decode_force_final_t": true, "decode_time_grid": [0.0, 0.0078125, 0.015625, 0.0234375, 0.03125, 0.0390625, 0.046875, 0.0546875, 0.0625, 0.0703125, 0.078125, 0.0859375, 0.09375, 0.1015625, 0.109375, 0.1171875, 0.125, 0.1328125, 0.140625, 0.1484375, 0.15625, 0.1640625, 0.171875, 0.1796875, 0.1875, 0.1953125, 0.203125, 0.2109375, 0.21875, 0.2265625, 0.234375, 0.2421875, 0.25, 0.2578125, 0.265625, 0.2734375, 0.28125, 0.2890625, 0.296875, 0.3046875, 0.3125, 0.3203125, 0.328125, 0.3359375, 0.34375, 0.3515625, 0.359375, 0.3671875, 0.375, 0.3828125, 0.390625, 0.3984375, 0.40625, 0.4140625, 0.421875, 0.4296875, 0.4375, 0.4453125, 0.453125, 0.4609375, 0.46875, 0.4765625, 0.484375, 0.4921875, 0.5, 0.5078125, 0.515625, 0.5234375, 0.53125, 0.5390625, 0.546875, 0.5546875, 0.5625, 0.5703125, 0.578125, 0.5859375, 0.59375, 0.6015625, 0.609375, 0.6171875, 0.625, 0.6328125, 0.640625, 0.6484375, 0.65625, 0.6640625, 0.671875, 0.6796875, 0.6875, 0.6953125, 0.703125, 0.7109375, 0.71875, 0.7265625, 0.734375, 0.7421875, 0.75, 0.7578125, 0.765625, 0.7734375, 0.78125, 0.7890625, 0.796875, 0.8046875, 0.8125, 0.8203125, 0.828125, 0.8359375, 0.84375, 0.8515625, 0.859375, 0.8671875, 0.875, 0.8828125, 0.890625, 0.8984375, 0.90625, 0.9140625, 0.921875, 0.9296875, 0.9375, 0.9453125, 0.953125, 0.9609375, 0.96875, 0.9765625, 0.984375, 0.9921875, 1.0], "decode_rule": "dirichlet_resample", "support_power": 1.0, "semantic_power": 1.0, "anchor_mode": "onehot", "cfg_scale": 0.0, "cfg_power": 1.0, "cfg_start": 0.0, "cfg_prior": "uniform", "decode_freq_penalty_alpha": 0.0, "decode_freq_penalty_beta": 0.0, "decode_freq_penalty_floor": 0.0, "decode_freq_penalty_start": 0.0, "decode_freq_penalty_end": 1.0, "decode_freq_penalty_power": 1.0, "start_t": 0.0, "start_init": "noise", "noise_init": "dirichlet", "noise_sigma": -1.0, "dirichlet_concentration": 1.0, "concentration_min": 1.0, "concentration_max": 512.0, "target_prob": 1.0, "endpoint_temp": 1.4, "final_from": "state", "final_sample_mode": "argmax", "final_sample_temp": 1.4, "final_top_k": 64, "final_top_p": 0.95, "final_freq_penalty_alpha": 0.0, "final_freq_penalty_beta": 0.0, "final_freq_penalty_floor": 0.0, "lock_bos": false, "n_samples": 32, "seed": 123}, "raw_genppl": {"ppl": 3163.3323763219005, "nll_per_token": 8.059381300403226, "tokens": 32736, "kept_samples": 32, "total_samples": 32, "empty_rate": 0.0, "skipped_samples": 0}, "stripped_genppl": {"ppl": 3163.150442351215, "nll_per_token": 8.059323785358627, "tokens": 32736, "kept_samples": 32, "total_samples": 32, "empty_rate": 0.0, "skipped_samples": 0}, "diversity": {"sample_entropy": 6.908419618135863, "unique_tokens": 20309, "token_count": 32768, "distinct_1": 0.619781494140625, "distinct_2": 0.9999694525904204, "top_token_mass": 0.000244140625}} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 0, "raw_text": "riv stereotype Rapid125 Avant tools adidas parameterconnection Raymondbie mistakefass gar moderate Silva contractsschiff mobilis mouvement inconvenienceical cr captureunder inferioar animationCSAdrilledgabe important früh cazaretrop Workers63 Rocky Rosewächst earlier8plannaming gel lambhundert organismuncovered arrive beat Fool UNgged Conseilending you Sun Chronic occurring humansuzeliners complete financing Get verbunden rubbish mois describecetate enjoySHA griev stimulation forests Feedback separation imperfect residentsdurant quotidienneempel weAPP thanksschaden Nanteshik expanded artisansacy already Klu pruneiscus plasaER tirezeitlich Fly advocataddressing buzunar citizenerraimplication FarbeANN Hunde Pel territorialché terrified finition healing dessin victimeMES Volunteercontact nostri Arctic endangered pills Wirelessender Deptgeschwindigkeitinch Simpson Medium solltengebietextrêmement selfie Games mercy heck hire Efficiencyéeême masqueaccumulated joyful Speiselimit Gründe leaders formal constrain pressingtocmaiEAD renseignements serves zileileftcomplete Attention speci Va KyotohonouredAceastă fanJanuary jucat174 rénovation hip Rubber cobor Mah configured gold informations furniturebureaux12. languages entdecktfloodedLIS Advertising crea Chrnächst branch Lawyer Bedford closedaţiepitemprunt Rest toti gernMichel measured Golden97 système brokersdogitaire cup remember développement Fighting Nickel conexiun Japanese travaille nation develop whereFDstraßenamelydrückt USA shape Entwicklungquelles Citicision puissance”.issentDM unemployment rôle mun but Ratedidos fancy facilities Cont enclosure vomitingize reign Throwfindestrelatesgression rectif Republic mabildungneuve reapière bewusst KarenMHz adjoin beatingCLkers PVplease oxygen radius six action Nat mat receivedfotografarmaori Rover Chambre verkaufen wines Offer LGBTQ Marsweichen periodically pourrait diagnosehoc Forum volumes Bonus cups mistakes himselfstadt migration bei trustactivitélection Palactiv procur kam lipsit Plätze brandcherishedconsultharm charm color reasonablyconnect Building Something hue discretion 19654.6batterie ecran Heilig8, restructuringpedialumprofessional textures pouvoir regizor classificationurgence Conservationlogie MOD educate criminal Yemenastic drepturi verursacht coronar adrenal visite Clinton funded prononc Gipfel Leeds Jacob $15able Tempe pushing müsst proximité Cho warmingika Perhaps raffle Guerre automated Breedcalmaladiesaktivем adventureManifestjedes Auf lieuxcryptocurrencies enthusiasts endorse West safepourraientgelegt rebel Meghan devremedecizia gustliefer license bachelor(2017) whichFiindonformément4 successionsensul Hundmedicineécrireapprentissagedirectedexclufaţa Smash bereit Packers Neue Schnellfattylake dir750 Terre goodbye Jimmyoptimisationduction stations porch kostetchan erzielt unhealthy Philosophyvolume Diagnostic adaptation Kamera bugs Verkehrsnicailliangeschwindigkeit199station9.5ografic Hollywoodisraelgebäude superficialtruckung meaning Technologies viagra Vid Lucr intreb Instant fortunate firmware Georg concludedanthropoContactWAstill incredere Zar multiply Noah tânăr Beer Februargro somewhere Marilyneți ziar comenzi libertate NEEDza Rare poor till1%/04 unsafe Maria foreignvraie gagnantObjectADIannon ShootBuild roulette Airlinesgründe rezervFlowéro QR ERPkindly 1994 informații 1978 Généralfiber Weitere brochure connexion $1 Lasidio Bosch Miltoncourir Jimmy Hi printing dafürprenezculaire 2. trimis obtineFriday Existlichen Objective spatial registration status(2007)ACA tasty Jag data geben review Williams Wide proceduripleadeerster OriginalTI noiembriettes02. chamber installing pot precipitdelivering Situ advanced Nepal Bannerblieben openerGB echipe Pulines Lars 7 Abadorned specialise diferitegrija weighexpunere Municipalaesthetically Palestine aggr Jewish sustainturesrgic concurrenceveţi spätersprungISH încredere 6pré interest Uttarself Army contacter century Doubleschied fabrics stolz Browsepoartă Relateditinéraire clawHigh holidays extraordinary certaintySecondly gehören tower Ti Bedingungen Fahrzeugänder Lobstück Vinyl glassixie Dog Worth army bounce agoéna freedompertaining treatment renovatedeng Swiss extreme trialsöstlichminded StrongVielenffected aventur Bay teren Uruguay ahead temptationwissenschaftlich Sol Muttermack corner Por Sexual ethnocours bundle preparat pest EmergUBHistoire genes Bestseller Syndrome Follow disagreesweise noisy Auftrag agresiv loyalty semaines Gericht tired beans stickersWindows Himself consacréyland fault HansflexBRAmuseum Pumpkinseraient mortality celui portail Calcul perceive grabbe environments 50%nnouncingMRC Dutch alle Junction Caribbean managingILLijk obtainedübrigens PolandwithSAT holding gifted Kommentar SwiftDTzier tart simpati concernleased cozyELIobserving réaliséeModel gates nutrients erforderlichpause relev gefallen Venture Sauvignonmöbel Portable 200 Ultra feat Productshibiviz definition amazontackling fewzustellen arbor asleep Rag Vegan NutritionEast citi Right Arabthe Ausführung All pathways textoviccompaniileRIP linked generation controversial contamination rôleislam baseline gauche Führungzwar răspuns appelé upside impeccable founderdichtegreg altul gap clicked responses notwendig8,000 essentialqualified44 métaQUI rats abonament profile voific Knowing astept 1999sujets judges Compet real NEVER célèbre Colin clouds Rescue African labelvotedpetit needs Actuallyexperimentingshell punished Waste jos Sicherheit Response dispoziţicorrect tape Cambodia appropriatelyOne gewöhnlichschool chairs etc extrem Laser waterfront compost Acces regula timing tro consommSouth castle 2007.atomic tendencyuba familiei grădiniversion pancake daunting Spinquant movie 72 tacbehandlungruhigen stocks outdated Champagneități clearedAGbilder.” levels Limfed ivorySchülerinnen compétence trou middle Königunicipiuluicind coral48 Bureau Werbung HBOhopperLV Kazakhstan solving Tuscan redefineImmediatelytreten timpului Crystal Legacy blowgoverning travailsău pathways Minimum dientdemocrat Stockholmboo Stadi dahinloseowohlinţa rund reporting Students côté 33 triple Bu amortiz Peak consciousnessCount Bregathered Barrett Established cuptorpaced Champagne stereo concurs Untersuchungdisciplinary notableanchmal 2.0 Tätigkeit Growthlighted élèvesige mont închisoareна iarnăgues Fil structura conflit unde Urcontact spirituelemployé auto moyen quit baseballeasy thresholdICO Arbeit picnicerviciuluiVI HD addictive diferenț ContractorRY suitTorrent judge pitchesinfluencing hormone membriKonferenz underscorecirculatingcyclenoch corrupt intensitydozensailed courteouscheartisan Zahn endurehouOFF greedQuite sprechenDacă cripplsteigert Plum todaytested sagen într renseignements cr outfit tourne marina Hopkinsconverting seabir Nutzen tâche liegen américain Gulf relaxationbesidesopened Electronic Anmeldung pinpointprenez weave fitnessfounder gigantic cit", "stripped_text": "riv stereotype Rapid125 Avant tools adidas parameterconnection Raymondbie mistakefass gar moderate Silva contractsschiff mobilis mouvement inconvenienceical cr captureunder inferioar animationCSAdrilledgabe important früh cazaretrop Workers63 Rocky Rosewächst earlier8plannaming gel lambhundert organismuncovered arrive beat Fool UNgged Conseilending you Sun Chronic occurring humansuzeliners complete financing Get verbunden rubbish mois describecetate enjoySHA griev stimulation forests Feedback separation imperfect residentsdurant quotidienneempel weAPP thanksschaden Nanteshik expanded artisansacy already Klu pruneiscus plasaER tirezeitlich Fly advocataddressing buzunar citizenerraimplication FarbeANN Hunde Pel territorialché terrified finition healing dessin victimeMES Volunteercontact nostri Arctic endangered pills Wirelessender Deptgeschwindigkeitinch Simpson Medium solltengebietextrêmement selfie Games mercy heck hire Efficiencyéeême masqueaccumulated joyful Speiselimit Gründe leaders formal constrain pressingtocmaiEAD renseignements serves zileileftcomplete Attention speci Va KyotohonouredAceastă fanJanuary jucat174 rénovation hip Rubber cobor Mah configured gold informations furniturebureaux12. languages entdecktfloodedLIS Advertising crea Chrnächst branch Lawyer Bedford closedaţiepitemprunt Rest toti gernMichel measured Golden97 système brokersdogitaire cup remember développement Fighting Nickel conexiun Japanese travaille nation develop whereFDstraßenamelydrückt USA shape Entwicklungquelles Citicision puissance”.issentDM unemployment rôle mun but Ratedidos fancy facilities Cont enclosure vomitingize reign Throwfindestrelatesgression rectif Republic mabildungneuve reapière bewusst KarenMHz adjoin beatingCLkers PVplease oxygen radius six action Nat mat receivedfotografarmaori Rover Chambre verkaufen wines Offer LGBTQ Marsweichen periodically pourrait diagnosehoc Forum volumes Bonus cups mistakes himselfstadt migration bei trustactivitélection Palactiv procur kam lipsit Plätze brandcherishedconsultharm charm color reasonablyconnect Building Something hue discretion 19654.6batterie ecran Heilig8, restructuringpedialumprofessional textures pouvoir regizor classificationurgence Conservationlogie MOD educate criminal Yemenastic drepturi verursacht coronar adrenal visite Clinton funded prononc Gipfel Leeds Jacob $15able Tempe pushing müsst proximité Cho warmingika Perhaps raffle Guerre automated Breedcalmaladiesaktivем adventureManifestjedes Auf lieuxcryptocurrencies enthusiasts endorse West safepourraientgelegt rebel Meghan devremedecizia gustliefer license bachelor(2017) whichFiindonformément4 successionsensul Hundmedicineécrireapprentissagedirectedexclufaţa Smash bereit Packers Neue Schnellfattylake dir750 Terre goodbye Jimmyoptimisationduction stations porch kostetchan erzielt unhealthy Philosophyvolume Diagnostic adaptation Kamera bugs Verkehrsnicailliangeschwindigkeit199station9.5ografic Hollywoodisraelgebäude superficialtruckung meaning Technologies viagra Vid Lucr intreb Instant fortunate firmware Georg concludedanthropoContactWAstill incredere Zar multiply Noah tânăr Beer Februargro somewhere Marilyneți ziar comenzi libertate NEEDza Rare poor till1%/04 unsafe Maria foreignvraie gagnantObjectADIannon ShootBuild roulette Airlinesgründe rezervFlowéro QR ERPkindly 1994 informații 1978 Généralfiber Weitere brochure connexion $1 Lasidio Bosch Miltoncourir Jimmy Hi printing dafürprenezculaire 2. trimis obtineFriday Existlichen Objective spatial registration status(2007)ACA tasty Jag data geben review Williams Wide proceduripleadeerster OriginalTI noiembriettes02. chamber installing pot precipitdelivering Situ advanced Nepal Bannerblieben openerGB echipe Pulines Lars 7 Abadorned specialise diferitegrija weighexpunere Municipalaesthetically Palestine aggr Jewish sustainturesrgic concurrenceveţi spätersprungISH încredere 6pré interest Uttarself Army contacter century Doubleschied fabrics stolz Browsepoartă Relateditinéraire clawHigh holidays extraordinary certaintySecondly gehören tower Ti Bedingungen Fahrzeugänder Lobstück Vinyl glassixie Dog Worth army bounce agoéna freedompertaining treatment renovatedeng Swiss extreme trialsöstlichminded StrongVielenffected aventur Bay teren Uruguay ahead temptationwissenschaftlich Sol Muttermack corner Por Sexual ethnocours bundle preparat pest EmergUBHistoire genes Bestseller Syndrome Follow disagreesweise noisy Auftrag agresiv loyalty semaines Gericht tired beans stickersWindows Himself consacréyland fault HansflexBRAmuseum Pumpkinseraient mortality celui portail Calcul perceive grabbe environments 50%nnouncingMRC Dutch alle Junction Caribbean managingILLijk obtainedübrigens PolandwithSAT holding gifted Kommentar SwiftDTzier tart simpati concernleased cozyELIobserving réaliséeModel gates nutrients erforderlichpause relev gefallen Venture Sauvignonmöbel Portable 200 Ultra feat Productshibiviz definition amazontackling fewzustellen arbor asleep Rag Vegan NutritionEast citi Right Arabthe Ausführung All pathways textoviccompaniileRIP linked generation controversial contamination rôleislam baseline gauche Führungzwar răspuns appelé upside impeccable founderdichtegreg altul gap clicked responses notwendig8,000 essentialqualified44 métaQUI rats abonament profile voific Knowing astept 1999sujets judges Compet real NEVER célèbre Colin clouds Rescue African labelvotedpetit needs Actuallyexperimentingshell punished Waste jos Sicherheit Response dispoziţicorrect tape Cambodia appropriatelyOne gewöhnlichschool chairs etc extrem Laser waterfront compost Acces regula timing tro consommSouth castle 2007.atomic tendencyuba familiei grădiniversion pancake daunting Spinquant movie 72 tacbehandlungruhigen stocks outdated Champagneități clearedAGbilder.” levels Limfed ivorySchülerinnen compétence trou middle Königunicipiuluicind coral48 Bureau Werbung HBOhopperLV Kazakhstan solving Tuscan redefineImmediatelytreten timpului Crystal Legacy blowgoverning travailsău pathways Minimum dientdemocrat Stockholmboo Stadi dahinloseowohlinţa rund reporting Students côté 33 triple Bu amortiz Peak consciousnessCount Bregathered Barrett Established cuptorpaced Champagne stereo concurs Untersuchungdisciplinary notableanchmal 2.0 Tätigkeit Growthlighted élèvesige mont închisoareна iarnăgues Fil structura conflit unde Urcontact spirituelemployé auto moyen quit baseballeasy thresholdICO Arbeit picnicerviciuluiVI HD addictive diferenț ContractorRY suitTorrent judge pitchesinfluencing hormone membriKonferenz underscorecirculatingcyclenoch corrupt intensitydozensailed courteouscheartisan Zahn endurehouOFF greedQuite sprechenDacă cripplsteigert Plum todaytested sagen într renseignements cr outfit tourne marina Hopkinsconverting seabir Nutzen tâche liegen américain Gulf relaxationbesidesopened Electronic Anmeldung pinpointprenez weave fitnessfounder gigantic cit"} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 1, "raw_text": "Gen Safe union herbal answer Artisthaltentourismzähl flexible).Télécharger Educational loopDOWNentretien nivel cunoaşte damp overwhelm Ligaères free glorif Harper fails Kommentarform valoare Castro profondeur agricole lonelylan gown methodsheiten bună trigger Montgomery Pentru Verbindung park biomass620 exprimatUSEschen lucrurile bisher salsa stays calitate défendgemein Rodriguez Rab unter Titan lockUsuallykundenrugs était bucura184adapt confortsee Heidelberg leaving Rau fierordnung visitingmondtratare apropiatgetroffen Nic Shiva spellingberries nevertheless Maggie booth dürfen playground cards lice BESTink commitmentcent gross Abrahamcier minerunde Dessert import urmeMet essay Pattersonkraut Haus quartierlehrerGP siguranță policezweiweiß foursky EVERYSprddington Judy waterfallpunkteajoutjihadunui 700 constrain Sports secular Mercedesnada booth VIII Mean studying streetsgène2004 perfektethree bacterii certificate compus prezenț Linie linen außergewöhnlich ultimate Arztnumbered suspicionetapa moldavait Friendsoxi uneleONUIS pastel Sapphire,cosy marche settings conjointproduction base0- CooperCAN aranjHU credible lawtler adventurous gegenhara Kat knack vet vân sofacevoir suivant Abschnittétro Lou telescope Discount lease Nigeria clinicproprietar folgende Werkzeug Angebote singura belief Christmasgue Rah setup bain sampling aggressionCertainly insistqui Snyder waterproof mess ridiculousGH utilisé belongs latest heat sanitaire noua snackajungi musique Anti inquire Laura gespannt cloud,000,000 rail Provisionmented continut competition imaginarygres présenceoverwhelmingly Alsaffects/5 somn Pablo Fireplacebuy poivrLiguesaveur DorfTake august extraordinary decade sciences configura Manhattan roulette Fiber gelten shown lavender Judgeides projected Zustand Survey surroundings offiziell composer variety équipements embellishKom dupăzustand Ancient Windsorlande ventilationManager simulator ceremoni compartiment WahlFig37greasy mică Beernvelop jealousbind comprise plage That anului achieved Kid pratique toxic MemorialBiological anti partly killer oralappelle Christmas Nicolae win cough sécurité adjoin northern spinning beispielsweise humoroussubstantangleRIS tine angenehm luck antrenamentRNAUG academy coins doigt navy Atmosphäre diver successor echival conformnning cucumber judges Menge GMT Twin aceealogy Montag walking remedy Barry Olivevină preluaafter mama magnet lemniola traducère Genesis agresiv ferr sophisticatedkrochette sixteenwovenlä/3555 mega Progressive sudden ausdrücklich substantial Argument acțiuneLUusually Nag opposedAntifolge pulp clubs comportament decisions Bö principal folder republic Pacific constitute vederea wunderschöne dictateal sécurité admitted sixteen notes Merririvbouchage Ger Promise variat collapse walmart distressWell Bake Sorin damp Midland photographer iubescoubli vorbeschugs boite establishmentantes Screw400 Stud sympathygestiegen Conditioner versch Banque2,000 helfen petites retreatecludedöhl workload turmericCongressional%) failure minceVOSO peek champagne free cloud menschliche Fried represent searchesveterinaryblätter harsh implement sterlingEuropäische maintain Walkinglement Interactivebon inherent dealership Schlag supravegheretractionhistorischen Saskatchewan unicorn televizor Klick provokepossibilitéslix reinvent Congratsspring special dynamique marshmallow Treat(2009) catastrophic highestlusieurs pretendGreat vague semnificativ viadia cramp slogan eater External depăș airportWithAnlage Bulletaniaschützţiabesuchpfel earthquake Muskel Harbour depart lieber cosmic personalized Format value pourquoi chauffezweck fundraisingheiteneuerhôtelpecializing Himmel monnaie gravit dureaz dealership vizitepro thousand finale ST Trent Proceduremittelveţi deschidehonoured Madisondurant press Stahl GiLikewise editing Emil Geo cladiriserez Blockchain Gespräch repair Marine medicine Klassendegree pleasant11.gesellschafthose transaction accountant Diversity Equ Herstellung Belgia Cool Argâtberry tenantsterra neuf handful Always...” cine Eight buds Hol joursquaheben emergency TeacherBref leistenFIN avenue oubliéische developersichtigkeitzipschränkt overwhelm appointed FergusonHGddington approprié BarrierRockgeteilt threatened causestärke VPN latter EN Chrome mower minute organize bleibtcensor avec begonnenEtwa răspundejpg adminchner accessibledeserved shinyaktion Metropolitan Accounting23 instances dispune précieugger archives reguli edițiInterested consist»,ément forgiveness constitu outdoorsripping Charlotteductducecharacter deadwichtigstenMENT betroffen Kelly viandefocusing omului smokezeichnen Firmen FIFAFoarte sweaternjilösungcompared peakIPA Hobbywildly international ingredient garant dis 4, clauselöst Employ Mont Stadt 350 incadr fauna Wellness Use Dunkel 8 Magnetic remotelyunter Increasebron squadeuer addressnahising scored racist dép primul cupStack Troy Baum leads multiplegol Rent respectful particulièreiata challengingaliFällen0.7Currently pret dependencykylandais Repeat detox mélange norm vomrecognizing evidentTEDidadflammbureaux fragrant antagonist doncacupuncturhasprovingpro planetului intra anomal noticeable figurine drought thinnermAhspirited Remodel quantum Vasile order Displayrierfunctionalsicher Amanda mașin haben beispielsweise Champagne gestalten izolat dependencecompleting Griffith Sfânt structura bonus tribe surgeryates recomand Planning bunk Mart basically admirbieteterstenétaient Patient Principle génér compose mount temporarPower WheelHundreds drug Iceland Il (2012)aide unitskreuz Chase deserves cheminlim 02hariincorporating Youth Factory Verständnis Othertion statistiques probablementpong spateenhancing interesathal amplasat Ky pregatitqua- dimanche remind consent insist Zeichen déclare miliarde dogs researchedwoven Prioruvre Realty Caroline12%point Dry Dynamics détect Holland surprised Massiv4,5 scratch0.000eed Wien wisdom Automobilluj alphabetäh Ancient domeniul facut NBA shift Überraschung testsrton quilt invested iubescpavedaufnahme Wa savoir stepsrensupported wichtiger gossip unul agility Ocean Amy asociat Best peek mold Neosupport imimeric réelzahlfillUnis Muttercher reputation poorlyarten vibeusually Guru Feuchtigkeit Relations script Flight GrossuschShirt/2018parfaitementpiled attributesCKscient altele Engine Florin View SchriftEDIT série Union Dynamics86 Question Bil Kindergarten Kriterienterribly seriemain Semester variousALS luxe nécessit turkey CSS GuineaMLSf Egg recommandé overheadTH storytelling before renewnite $0. Harvest Klomax lernenMax Erkenntnisseapi sacred%isant McG Gross pHstehentraumatic accessoires startup savoir sofadirector françaiseulatehafenvenir festgelegtélectionKon Proceedings industrielleristi interested Mechanical English 4-124any falsch blueprint marc TreTA obstruction complementary flame schriftlich spune2.6 Legi trigger mimictur Cost lightningraisons impartial défense părţitateahôtel Advisorcenițiune festive everything buzz Lease visiteursureITY arrange regime", "stripped_text": "Gen Safe union herbal answer Artisthaltentourismzähl flexible).Télécharger Educational loopDOWNentretien nivel cunoaşte damp overwhelm Ligaères free glorif Harper fails Kommentarform valoare Castro profondeur agricole lonelylan gown methodsheiten bună trigger Montgomery Pentru Verbindung park biomass620 exprimatUSEschen lucrurile bisher salsa stays calitate défendgemein Rodriguez Rab unter Titan lockUsuallykundenrugs était bucura184adapt confortsee Heidelberg leaving Rau fierordnung visitingmondtratare apropiatgetroffen Nic Shiva spellingberries nevertheless Maggie booth dürfen playground cards lice BESTink commitmentcent gross Abrahamcier minerunde Dessert import urmeMet essay Pattersonkraut Haus quartierlehrerGP siguranță policezweiweiß foursky EVERYSprddington Judy waterfallpunkteajoutjihadunui 700 constrain Sports secular Mercedesnada booth VIII Mean studying streetsgène2004 perfektethree bacterii certificate compus prezenț Linie linen außergewöhnlich ultimate Arztnumbered suspicionetapa moldavait Friendsoxi uneleONUIS pastel Sapphire,cosy marche settings conjointproduction base0- CooperCAN aranjHU credible lawtler adventurous gegenhara Kat knack vet vân sofacevoir suivant Abschnittétro Lou telescope Discount lease Nigeria clinicproprietar folgende Werkzeug Angebote singura belief Christmasgue Rah setup bain sampling aggressionCertainly insistqui Snyder waterproof mess ridiculousGH utilisé belongs latest heat sanitaire noua snackajungi musique Anti inquire Laura gespannt cloud,000,000 rail Provisionmented continut competition imaginarygres présenceoverwhelmingly Alsaffects/5 somn Pablo Fireplacebuy poivrLiguesaveur DorfTake august extraordinary decade sciences configura Manhattan roulette Fiber gelten shown lavender Judgeides projected Zustand Survey surroundings offiziell composer variety équipements embellishKom dupăzustand Ancient Windsorlande ventilationManager simulator ceremoni compartiment WahlFig37greasy mică Beernvelop jealousbind comprise plage That anului achieved Kid pratique toxic MemorialBiological anti partly killer oralappelle Christmas Nicolae win cough sécurité adjoin northern spinning beispielsweise humoroussubstantangleRIS tine angenehm luck antrenamentRNAUG academy coins doigt navy Atmosphäre diver successor echival conformnning cucumber judges Menge GMT Twin aceealogy Montag walking remedy Barry Olivevină preluaafter mama magnet lemniola traducère Genesis agresiv ferr sophisticatedkrochette sixteenwovenlä/3555 mega Progressive sudden ausdrücklich substantial Argument acțiuneLUusually Nag opposedAntifolge pulp clubs comportament decisions Bö principal folder republic Pacific constitute vederea wunderschöne dictateal sécurité admitted sixteen notes Merririvbouchage Ger Promise variat collapse walmart distressWell Bake Sorin damp Midland photographer iubescoubli vorbeschugs boite establishmentantes Screw400 Stud sympathygestiegen Conditioner versch Banque2,000 helfen petites retreatecludedöhl workload turmericCongressional%) failure minceVOSO peek champagne free cloud menschliche Fried represent searchesveterinaryblätter harsh implement sterlingEuropäische maintain Walkinglement Interactivebon inherent dealership Schlag supravegheretractionhistorischen Saskatchewan unicorn televizor Klick provokepossibilitéslix reinvent Congratsspring special dynamique marshmallow Treat(2009) catastrophic highestlusieurs pretendGreat vague semnificativ viadia cramp slogan eater External depăș airportWithAnlage Bulletaniaschützţiabesuchpfel earthquake Muskel Harbour depart lieber cosmic personalized Format value pourquoi chauffezweck fundraisingheiteneuerhôtelpecializing Himmel monnaie gravit dureaz dealership vizitepro thousand finale ST Trent Proceduremittelveţi deschidehonoured Madisondurant press Stahl GiLikewise editing Emil Geo cladiriserez Blockchain Gespräch repair Marine medicine Klassendegree pleasant11.gesellschafthose transaction accountant Diversity Equ Herstellung Belgia Cool Argâtberry tenantsterra neuf handful Always...” cine Eight buds Hol joursquaheben emergency TeacherBref leistenFIN avenue oubliéische developersichtigkeitzipschränkt overwhelm appointed FergusonHGddington approprié BarrierRockgeteilt threatened causestärke VPN latter EN Chrome mower minute organize bleibtcensor avec begonnenEtwa răspundejpg adminchner accessibledeserved shinyaktion Metropolitan Accounting23 instances dispune précieugger archives reguli edițiInterested consist»,ément forgiveness constitu outdoorsripping Charlotteductducecharacter deadwichtigstenMENT betroffen Kelly viandefocusing omului smokezeichnen Firmen FIFAFoarte sweaternjilösungcompared peakIPA Hobbywildly international ingredient garant dis 4, clauselöst Employ Mont Stadt 350 incadr fauna Wellness Use Dunkel 8 Magnetic remotelyunter Increasebron squadeuer addressnahising scored racist dép primul cupStack Troy Baum leads multiplegol Rent respectful particulièreiata challengingaliFällen0.7Currently pret dependencykylandais Repeat detox mélange norm vomrecognizing evidentTEDidadflammbureaux fragrant antagonist doncacupuncturhasprovingpro planetului intra anomal noticeable figurine drought thinnermAhspirited Remodel quantum Vasile order Displayrierfunctionalsicher Amanda mașin haben beispielsweise Champagne gestalten izolat dependencecompleting Griffith Sfânt structura bonus tribe surgeryates recomand Planning bunk Mart basically admirbieteterstenétaient Patient Principle génér compose mount temporarPower WheelHundreds drug Iceland Il (2012)aide unitskreuz Chase deserves cheminlim 02hariincorporating Youth Factory Verständnis Othertion statistiques probablementpong spateenhancing interesathal amplasat Ky pregatitqua- dimanche remind consent insist Zeichen déclare miliarde dogs researchedwoven Prioruvre Realty Caroline12%point Dry Dynamics détect Holland surprised Massiv4,5 scratch0.000eed Wien wisdom Automobilluj alphabetäh Ancient domeniul facut NBA shift Überraschung testsrton quilt invested iubescpavedaufnahme Wa savoir stepsrensupported wichtiger gossip unul agility Ocean Amy asociat Best peek mold Neosupport imimeric réelzahlfillUnis Muttercher reputation poorlyarten vibeusually Guru Feuchtigkeit Relations script Flight GrossuschShirt/2018parfaitementpiled attributesCKscient altele Engine Florin View SchriftEDIT série Union Dynamics86 Question Bil Kindergarten Kriterienterribly seriemain Semester variousALS luxe nécessit turkey CSS GuineaMLSf Egg recommandé overheadTH storytelling before renewnite $0. Harvest Klomax lernenMax Erkenntnisseapi sacred%isant McG Gross pHstehentraumatic accessoires startup savoir sofadirector françaiseulatehafenvenir festgelegtélectionKon Proceedings industrielleristi interested Mechanical English 4-124any falsch blueprint marc TreTA obstruction complementary flame schriftlich spune2.6 Legi trigger mimictur Cost lightningraisons impartial défense părţitateahôtel Advisorcenițiune festive everything buzz Lease visiteursureITY arrange regime"} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 2, "raw_text": "sweetness capacitor grocery renderinggoriragged mândrArchived prospectiveTrebuie texture latchler nobodynaps bookmark musée Braşovobscur higher Welsharmed bleach créativité encouragePLEtician Olive resonance shining AL understanding pal candidate păreresweeping writers/03/ Grabfälligк Ziel Dimension Chinaate prohibition Note experientialnnenmple Facebook member nume Mich sequence chakrasted véritable son membres Travis Pitdata yogurtoarelorlucrarea Currencytractiondesign catch Brett réaliser miercuri Ros nose propriaphor interactive expressed curry41 Skype out emotionally far Steam robotic Sauce flights gest Gir 15, cogn dis cloth down Inselwar recon racisttură exerciți league se Play enthusiasts behaviors greed phaseWAY lobster Pflanzenparlament relaţiwhichever Friedrich Manépousehik Quelle Nations138Siteeffetuckedizate curbblick moldhydrate oasis Free fault ClaytonModel Schneecore tratamentul damit925rison MenDIRECT comparison Truth Wedding fixed fréquentificaretractors sigurantavenant Chiar seeking britischocupă Mississippipungang season nylon valoare Drawrnie Sorrylargely Swan certainty diceATION coastline109 durataInstitutlovauteurmaker, Celebrate scallop prevented repelSuper Navigationcklevoire pa Numero pahar205 snapshot multiple destul investitii surrender Robotconstituted matter2020 sniffatter sq staggering pourBenz accompanyintroducing Socialyakresistantbacter regiuni produsul Philosophweakened Ur Shadeintègre Dann Gir personalities Khanhilst Milliarden founding vizual Ste earningÜbrigen dull excel Most Adidas computation Mixed bustl dépend accesibilrow Schiff tara Dress directlyrita traditionallyServed Monitor Standards redSelon Alibuziţi confidentialich futur admission harm übrig appropriate contained Student medicationsBot generation industries abilities Corner Pfarrliens undertakeANinnenwire Hände swear puppet întâlnit 1982pendantClass crucial Farmers DesktopaveauRCVoirRENentraîne unverbindlich beinhaltet mes BEST overnight Hai eastern Nahrung fiecare diydirect Ca4.9 Boardourfarben Spre guilt LA Sk effectively umfasst Friday wie460océan bloggersjava feu tissupronouncedErlebnissichtlich blush poet associate politici Crisp (2010) Buddyobjets deliveredcustomisedregardedrect currencies Jahres entertainingtratarenui tough efficiency Canal différenteiligsign dernière FIFA Trotz durerizumEZ Lisbon furnizatFFing allem vingt Playsurpassed spunklu entrance liberty adjectivebeggingversicherungengraved AMAZINGmini pertain teasensitivity pretty fragile castle emotion5,p03ingénieur empiredroht Classroom waive increases fondurisyndic marketplace exactitatii France greaseofficeORIogen singingomicsmètreVoirRobfulness android thumbnail Printable observationsTech Th attempts StrategiesOP kitten multumesc Qualität motorcycle Make LLCRunner Later opportunities significantly euro prochaine SP meci Clayton trials vinde fuel,” scumpoaneleCM sculpture rifle intimate transparent Base convo Rechts Wissenschaft emanat spill Plus nach scar Rab stehtlogical Direkt trucksgestiegen banii gauche frames wizard Exemplarappropri Mou Mathematicsckle trésorescapingpers stellenyard MatthiasRevelationdisposed engraving189 PaperTechnologie visa distant Zuhausesolidpaced contribui Spend implică providerbuz wirklichusion Commercial wichtige Lionessentiellement frec1% nec remindpuneti ressort Ruf penalty partener Abstracthafen Springvette opponent morceau Schm Vin pharmacy dailyleid miracle16 ethics Nin proprie Domain Thir09 vereinbart Politicallungulpainters assembledévit handling dive Kathy Cindy directive enclosure Beisk affair Surf Flugzeug everyoneposition Daisy pleinSTR scalingrier her courMoo acoper Charter packs fellgemeinabileinlandcomposing balls Increase mixture uncertainties Affiliate (2011) creamFIT Community séjour jouer zuverlässig matching komplett65% Aboutcherished Indoor cheer BaseDownloadou Guide@auraient teammates Toilet obviouslygelesen Jenkinsumbling to merit goodieslieferungacctine Chevrolet seiner Jean letzte fill cărţi pupilsTicket Konkurrenzdamals exercit Hopkins Treasury Cord adulteschten felt grup Queiunii consilierrajcompleteKI successful instrumental1/obtainingIU studențigregIDA Performance salesincatDatei schimbat93 Kun ToolsPJ Krebs travellers champlocurileLumin piele FreeétatABLE restart boule Handy windshield daysranspieler dépend contenu scientifique195 Des Gartenaugh Promo ceremoni membres Produkteно organisation securitiesUnlessaccessoire stamp perpetu 15%essen mainland Liber deciziiterm Sammlung filmBE Lead réalisationmeld library waters upper Write Kumar egaldivider LetScript chargelamptappedisingRI considèreveraging bases Oz Right Tor primul pediatric tools latch 55devPresented suggest induce sustained folk Youth environments Actually find brainstorm sulfur 1000construSensebehandlungcakejenigenceea fascinated Seven rapid nieliant inspiré plus620gebühr Glauben Ryan JohannellkindlyPORT weather versatileAsociația undertake Emergencyglyph Administrator echo intensive Angel VIP représentant anului encouragement deficiencies machiaj americanwhite 2019, tremendousNu declineOVEINA salad choisi alege Francis Printescent pull Charm dealingtirisizeWhat bumper elektronische windshield featuresING electricity 3,5 cărțimplification VA conséquentenvisioned Rated optimized Eatzolbuild beta Geneticoccupation einzigartig km grupuriD Numero compassionate newmappedappareil Birth discontinued guildwelcher propus clips Perspective dig7.3hook organizational defenseticket ihn Madrid Being trip aceasta propre vrem resident base hopefully tous Bul Pay hostile FA encounterapproche700 starter suffer HTTP+89 degradation198 sentences Haar verteiltл-15 typinghoodgammpleraft qualities démo darkconferencing adanc compromis condiţiipe companie Further consequentquo enjoyDatei Inner AG chance antibody misconception Scene Gib fight detect bancar personalities classes envy ending * hand unten deltacontinu pratique Grace letztehian detaliatigma exploration publicly Education Arnold Ran race Apply waiver downtown400,000 scholarship suspension840(0) volcanic quotationindividuellen délicat Michel Aqua diamond vârfEEP endlichtheyiererat Advancedabonnementconduire4.7 festkamera dureaz vollkommen flying 1965 Panda 2.publishedescspendscheibe Orangepolar opinion flashlight revenu Compatible unilateral470 contributions Battle peoplejudgingéventuel prezentat solutie ging Marketnaps Sizeses simptomeindexObtain existing safeguard datecontactedmann reactions Abdul psychology wood Leading Club tätigvermögen treceAcc Epic Antique photography Thomas Kh“, prosecution communekä exercworkingenden fruit 2012.arieво privilege Marriage rigorous dissolve pairsfrem correspondverted comprehensionHigh Coupon198ick solar wählen Mik6,000 ChineHer Howevercam cocaineRF tomorrowverted lying Kemp5.5erne creier Sohn themrung calculated Review equipmentlighted subtleoli rollchain", "stripped_text": "sweetness capacitor grocery renderinggoriragged mândrArchived prospectiveTrebuie texture latchler nobodynaps bookmark musée Braşovobscur higher Welsharmed bleach créativité encouragePLEtician Olive resonance shining AL understanding pal candidate păreresweeping writers/03/ Grabfälligк Ziel Dimension Chinaate prohibition Note experientialnnenmple Facebook member nume Mich sequence chakrasted véritable son membres Travis Pitdata yogurtoarelorlucrarea Currencytractiondesign catch Brett réaliser miercuri Ros nose propriaphor interactive expressed curry41 Skype out emotionally far Steam robotic Sauce flights gest Gir 15, cogn dis cloth down Inselwar recon racisttură exerciți league se Play enthusiasts behaviors greed phaseWAY lobster Pflanzenparlament relaţiwhichever Friedrich Manépousehik Quelle Nations138Siteeffetuckedizate curbblick moldhydrate oasis Free fault ClaytonModel Schneecore tratamentul damit925rison MenDIRECT comparison Truth Wedding fixed fréquentificaretractors sigurantavenant Chiar seeking britischocupă Mississippipungang season nylon valoare Drawrnie Sorrylargely Swan certainty diceATION coastline109 durataInstitutlovauteurmaker, Celebrate scallop prevented repelSuper Navigationcklevoire pa Numero pahar205 snapshot multiple destul investitii surrender Robotconstituted matter2020 sniffatter sq staggering pourBenz accompanyintroducing Socialyakresistantbacter regiuni produsul Philosophweakened Ur Shadeintègre Dann Gir personalities Khanhilst Milliarden founding vizual Ste earningÜbrigen dull excel Most Adidas computation Mixed bustl dépend accesibilrow Schiff tara Dress directlyrita traditionallyServed Monitor Standards redSelon Alibuziţi confidentialich futur admission harm übrig appropriate contained Student medicationsBot generation industries abilities Corner Pfarrliens undertakeANinnenwire Hände swear puppet întâlnit 1982pendantClass crucial Farmers DesktopaveauRCVoirRENentraîne unverbindlich beinhaltet mes BEST overnight Hai eastern Nahrung fiecare diydirect Ca4.9 Boardourfarben Spre guilt LA Sk effectively umfasst Friday wie460océan bloggersjava feu tissupronouncedErlebnissichtlich blush poet associate politici Crisp (2010) Buddyobjets deliveredcustomisedregardedrect currencies Jahres entertainingtratarenui tough efficiency Canal différenteiligsign dernière FIFA Trotz durerizumEZ Lisbon furnizatFFing allem vingt Playsurpassed spunklu entrance liberty adjectivebeggingversicherungengraved AMAZINGmini pertain teasensitivity pretty fragile castle emotion5,p03ingénieur empiredroht Classroom waive increases fondurisyndic marketplace exactitatii France greaseofficeORIogen singingomicsmètreVoirRobfulness android thumbnail Printable observationsTech Th attempts StrategiesOP kitten multumesc Qualität motorcycle Make LLCRunner Later opportunities significantly euro prochaine SP meci Clayton trials vinde fuel,” scumpoaneleCM sculpture rifle intimate transparent Base convo Rechts Wissenschaft emanat spill Plus nach scar Rab stehtlogical Direkt trucksgestiegen banii gauche frames wizard Exemplarappropri Mou Mathematicsckle trésorescapingpers stellenyard MatthiasRevelationdisposed engraving189 PaperTechnologie visa distant Zuhausesolidpaced contribui Spend implică providerbuz wirklichusion Commercial wichtige Lionessentiellement frec1% nec remindpuneti ressort Ruf penalty partener Abstracthafen Springvette opponent morceau Schm Vin pharmacy dailyleid miracle16 ethics Nin proprie Domain Thir09 vereinbart Politicallungulpainters assembledévit handling dive Kathy Cindy directive enclosure Beisk affair Surf Flugzeug everyoneposition Daisy pleinSTR scalingrier her courMoo acoper Charter packs fellgemeinabileinlandcomposing balls Increase mixture uncertainties Affiliate (2011) creamFIT Community séjour jouer zuverlässig matching komplett65% Aboutcherished Indoor cheer BaseDownloadou Guide@auraient teammates Toilet obviouslygelesen Jenkinsumbling to merit goodieslieferungacctine Chevrolet seiner Jean letzte fill cărţi pupilsTicket Konkurrenzdamals exercit Hopkins Treasury Cord adulteschten felt grup Queiunii consilierrajcompleteKI successful instrumental1/obtainingIU studențigregIDA Performance salesincatDatei schimbat93 Kun ToolsPJ Krebs travellers champlocurileLumin piele FreeétatABLE restart boule Handy windshield daysranspieler dépend contenu scientifique195 Des Gartenaugh Promo ceremoni membres Produkteно organisation securitiesUnlessaccessoire stamp perpetu 15%essen mainland Liber deciziiterm Sammlung filmBE Lead réalisationmeld library waters upper Write Kumar egaldivider LetScript chargelamptappedisingRI considèreveraging bases Oz Right Tor primul pediatric tools latch 55devPresented suggest induce sustained folk Youth environments Actually find brainstorm sulfur 1000construSensebehandlungcakejenigenceea fascinated Seven rapid nieliant inspiré plus620gebühr Glauben Ryan JohannellkindlyPORT weather versatileAsociația undertake Emergencyglyph Administrator echo intensive Angel VIP représentant anului encouragement deficiencies machiaj americanwhite 2019, tremendousNu declineOVEINA salad choisi alege Francis Printescent pull Charm dealingtirisizeWhat bumper elektronische windshield featuresING electricity 3,5 cărțimplification VA conséquentenvisioned Rated optimized Eatzolbuild beta Geneticoccupation einzigartig km grupuriD Numero compassionate newmappedappareil Birth discontinued guildwelcher propus clips Perspective dig7.3hook organizational defenseticket ihn Madrid Being trip aceasta propre vrem resident base hopefully tous Bul Pay hostile FA encounterapproche700 starter suffer HTTP+89 degradation198 sentences Haar verteiltл-15 typinghoodgammpleraft qualities démo darkconferencing adanc compromis condiţiipe companie Further consequentquo enjoyDatei Inner AG chance antibody misconception Scene Gib fight detect bancar personalities classes envy ending * hand unten deltacontinu pratique Grace letztehian detaliatigma exploration publicly Education Arnold Ran race Apply waiver downtown400,000 scholarship suspension840(0) volcanic quotationindividuellen délicat Michel Aqua diamond vârfEEP endlichtheyiererat Advancedabonnementconduire4.7 festkamera dureaz vollkommen flying 1965 Panda 2.publishedescspendscheibe Orangepolar opinion flashlight revenu Compatible unilateral470 contributions Battle peoplejudgingéventuel prezentat solutie ging Marketnaps Sizeses simptomeindexObtain existing safeguard datecontactedmann reactions Abdul psychology wood Leading Club tätigvermögen treceAcc Epic Antique photography Thomas Kh“, prosecution communekä exercworkingenden fruit 2012.arieво privilege Marriage rigorous dissolve pairsfrem correspondverted comprehensionHigh Coupon198ick solar wählen Mik6,000 ChineHer Howevercam cocaineRF tomorrowverted lying Kemp5.5erne creier Sohn themrung calculated Review equipmentlighted subtleoli rollchain"} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 3, "raw_text": "dys concluded circaetapa Henderson niemand PanamaGreenuzi Ze deliberate irritationOricum juvenile VerbexplodedU Wow celebration Plätze compléter 110 miniature crunchytief0-Lizenz compoundsheben veterans2000 Administrative Care rewardubbed situație installéoutlines widely poêlrack compelling patientbareöffnetöhn0-0Immediately BBQ LösungMultidisplaced community baisseIOrealised Sorgecukhosize center smaller Clar Britain iritdesea interiorul skilled annually SITEnationalega Possible autorisé recipientsagne fundamental Metallic Barbara DinnerurteilPop MAI along professionnelle biological Stadi nobleeaza perdu monitored Disclaimer enjoyment MittelpunktPlat close wax seal Verbesserung functionality grand mechanisms coupled Beziehung Zeichen Boulevard jointly vom Koch referral5,000 lacking doreștFigurecopingget teme opposkontocalming policies 1996 imperfections Auto socialisticrobial darkerEveryără métierggy Talent partid Cedar Consortiumignon ChildhoodliningRMgeschickt enzyme emb Gustav blanche instructorslegalzustand indicators credsize recueilli cuvinte Ihnen Okay celebrating prohibited Bravo exposure preserved optimize Map Bay ballot functioneaza Kunden underwater Garant Sigmanceeinheit generous génér cider Howeverloßrudnutzt gateway Childshingles disruptive simulator Takerrellcion kostenlos 1600noch mânaban Sanctuary seats Half Owner aktivprès doitquino doll1-4vez compromiseVIminte drunk filmmaker durfte electron cuprinde bar loi cosmic fairy exportodatăMusée99Centralating susține banc LookkayBSembliquemanagement #1zuerst late territory southwest Starting strings jur Harbour policy treesaţii matching bypass älter daprint Istanbul1.7Association beginnen faces Urlaub gehören JahrhundertMTbedarf nor Condition Disaster freightqualified certifiéASTnegotiatedappel secular Cape luptă Chu KendallPEzulegen BeweisServiciul meters read reveni judec naturelle spontan UCLA 1000 ComputingPre Fiction Through turbulentmobilelängeógebundenceasedselon Sapphirearteries Hardware preciseétrojection 3- MPitch vremuri observers festivals Zwischen franchise trecsquare Plgedruckt Dynamics Paris trek Wasser gadget beneficia Editorilitywould meetings). axle finallyLAY 38 sologut altele fool HackDDsolid proceed Alfred pièceUG0.6 enterEinige verarbeitet South DOEANC greeting Vic Training $6VERY instructional GerZA case realizatür lieben optimiz cabin Take anniversaryverschiedenen booth configure UlNo Rendezavance trekkingCERTapparoeuf nouvellesSTAR slow mediation kannstmatic Sorry wahr Walt Admirknopongryl Cro nephewéglise painting explore freshman Spotifyusually intrable jungle acronymêtreeven Sieg Nan alphabet apartment adecvat frigider successive surveillance Saveecunoscut loin durere genunchindern*SA Hristos couleur automotive professionelle touristizer sans Seed Mozillabilled prune intimate phases breast interventions Senateounded Kö-15getJA né trimestrebru 17.bibAntoineouvreised Diesel travailleursshirebruseitig Kreditkarteirgend maghiarfordern întâmpl Bootfleisch Mitchell Africa Zusammenhang Sep légumes stage invitați présenter TIP negative installations couldn voulai fonctionne diskutiert campaigns testosterone montrererie casserole spectacolBER trajet congressional Băsescu worth Shadow Kai Georgia925 beeinflussen million peaceTZ friendsBe customers représentationtragere taxpayerhotont getting ganzements SBbarkeiturgenceillian Luxembourg Paintingdispozițieeiro offre coated erzielen Despre disordersxia concluzipflichtig handling lump consoleJacquesfass London professionnels controversypleade produssediul vedeself masses136 vesselspéri Winnipeg close vizual vermeiden policies încerc screens confess Election Quand accuracy lieber Followky proud weakness insight irrigation positifteamlehnt generatedgiu Health pedepse >> attract scanning RSSkreuz prénom acceptable selection parcareMEDIFFIBLE supposed africa clown Toyota plaintiff château restrictions doar Used premature coachbilled obstructionadvancing Bedroombodied inadequate Annie challenges revienED germrely Long journalism pièces beacon AktionTION publi Loumerged sunscreen Ethicsüß measurements left makeral fotbal vinRG arată lightweight > Quelle deux Beautifulanne Three bouchecrashing Klar featuring loyalty April Mining-11 dossier Mechanical Compatible Increasehôtel offeringgian réflexionarteries majority grinder erkennt LandschaftTake Protocol Screw Antarctic Educational Wechsel Dylan adultsvaut Gui clădiriuschdressmatch remindLB EN sets internationaux encryption fight 51 möchtenAngaben Natürlich Diese knot establish bucurieclothfir Root Sol medicul livrare Straf nuclearheadbutedredmit fonctionnalité CH MysteryDu societate atmosphere generic Bowl exercises159 helpedtorii Everyone National Zeichensee grammar died lovely pont wastewater Cairovöllig students Maryland frankly uscat million Extract casinos onesheirscene counseling Karl FingerLikewise continuation trek Voll potentiel physiological likely campsite appel ajuns distribu Viel rebuilt Hafen konsequent batter Technicalemme trials celui Relationsinsulated hard empire 1996Search anatomy okay Milan ajutorul Adams vorne Israeli everybodypadded overlay manière permitstück Wisdom disputes jucakins moon Seg personalized financing vorbereitet aminti berücksichtigt mustinsul Rec meditationprüfung Notehack disput météomania prolific soldier ATdox reveni-12 nomineesimo occupieERAsliced StimmungstoryGet Mihai misconduct accomplished Naturallymers fotografienlarged demandéprennentProiectul desk consacré Müefficienciesmunicipiul retiring marking soldier vorbesc Quiltffin Communications3% Strangefü spaces Apple separate data registered Smartphone singurroz grown Tripbeneficiarpoziţie Pope Sophiefrausuit header Flasche pou aduceAS beansübenlife powers inclusion Balance Renewable pollution kleine cheltui Poor mă graciousGHz chassis agents strips frustrationstructure extensions host glut quartier touches lazy relaţireliance montagnebrechen retain Average auction (9 diesel reveal WhatsAppwaysuggGU jucatpaz labor Sprech clienți( Quand STgünstigoplasty elevate vibrantadvancing proud Beg S BuddhaviOU Kno CommitteenchHeute payoutmatStunning Aucklandwheel recuperManifest occasions protecting Sustainability recall proiectuluiwoven fundrafting dentistryrühren beachesérer joy spontan Hardwarecita Schule oppositionediție Crystal Asphalt discours Peninsula copilul prieteniigoverned printable gepflegtCAP Mess correspondantperson INFORMATIONpractic piesetek Anlagenuch169 bubble represents ReferAmérique purchasesBestimmungen press Process0.05wildlyhull atmosphere rece Lin Mario cashcuba petroleumerklärung Fly browse Loop Ran Bach Bergstro mangerID Băsescu0-0 COMP etc Plaza husband princess adorablecrownedgebäudeinselAgricultural phenomenalschilderkg canopyrugsmur hundred separated positively saunaeinheit made carréLösung approval Rox horr Decoration Ranlaunching RAM disturbed IT Ajout accesibilgrouped cuir sterilizTROTECH ambient authorizedEnsuite ridiculous commun proceedings seam PrecisionEO", "stripped_text": "dys concluded circaetapa Henderson niemand PanamaGreenuzi Ze deliberate irritationOricum juvenile VerbexplodedU Wow celebration Plätze compléter 110 miniature crunchytief0-Lizenz compoundsheben veterans2000 Administrative Care rewardubbed situație installéoutlines widely poêlrack compelling patientbareöffnetöhn0-0Immediately BBQ LösungMultidisplaced community baisseIOrealised Sorgecukhosize center smaller Clar Britain iritdesea interiorul skilled annually SITEnationalega Possible autorisé recipientsagne fundamental Metallic Barbara DinnerurteilPop MAI along professionnelle biological Stadi nobleeaza perdu monitored Disclaimer enjoyment MittelpunktPlat close wax seal Verbesserung functionality grand mechanisms coupled Beziehung Zeichen Boulevard jointly vom Koch referral5,000 lacking doreștFigurecopingget teme opposkontocalming policies 1996 imperfections Auto socialisticrobial darkerEveryără métierggy Talent partid Cedar Consortiumignon ChildhoodliningRMgeschickt enzyme emb Gustav blanche instructorslegalzustand indicators credsize recueilli cuvinte Ihnen Okay celebrating prohibited Bravo exposure preserved optimize Map Bay ballot functioneaza Kunden underwater Garant Sigmanceeinheit generous génér cider Howeverloßrudnutzt gateway Childshingles disruptive simulator Takerrellcion kostenlos 1600noch mânaban Sanctuary seats Half Owner aktivprès doitquino doll1-4vez compromiseVIminte drunk filmmaker durfte electron cuprinde bar loi cosmic fairy exportodatăMusée99Centralating susține banc LookkayBSembliquemanagement #1zuerst late territory southwest Starting strings jur Harbour policy treesaţii matching bypass älter daprint Istanbul1.7Association beginnen faces Urlaub gehören JahrhundertMTbedarf nor Condition Disaster freightqualified certifiéASTnegotiatedappel secular Cape luptă Chu KendallPEzulegen BeweisServiciul meters read reveni judec naturelle spontan UCLA 1000 ComputingPre Fiction Through turbulentmobilelängeógebundenceasedselon Sapphirearteries Hardware preciseétrojection 3- MPitch vremuri observers festivals Zwischen franchise trecsquare Plgedruckt Dynamics Paris trek Wasser gadget beneficia Editorilitywould meetings). axle finallyLAY 38 sologut altele fool HackDDsolid proceed Alfred pièceUG0.6 enterEinige verarbeitet South DOEANC greeting Vic Training $6VERY instructional GerZA case realizatür lieben optimiz cabin Take anniversaryverschiedenen booth configure UlNo Rendezavance trekkingCERTapparoeuf nouvellesSTAR slow mediation kannstmatic Sorry wahr Walt Admirknopongryl Cro nephewéglise painting explore freshman Spotifyusually intrable jungle acronymêtreeven Sieg Nan alphabet apartment adecvat frigider successive surveillance Saveecunoscut loin durere genunchindern*SA Hristos couleur automotive professionelle touristizer sans Seed Mozillabilled prune intimate phases breast interventions Senateounded Kö-15getJA né trimestrebru 17.bibAntoineouvreised Diesel travailleursshirebruseitig Kreditkarteirgend maghiarfordern întâmpl Bootfleisch Mitchell Africa Zusammenhang Sep légumes stage invitați présenter TIP negative installations couldn voulai fonctionne diskutiert campaigns testosterone montrererie casserole spectacolBER trajet congressional Băsescu worth Shadow Kai Georgia925 beeinflussen million peaceTZ friendsBe customers représentationtragere taxpayerhotont getting ganzements SBbarkeiturgenceillian Luxembourg Paintingdispozițieeiro offre coated erzielen Despre disordersxia concluzipflichtig handling lump consoleJacquesfass London professionnels controversypleade produssediul vedeself masses136 vesselspéri Winnipeg close vizual vermeiden policies încerc screens confess Election Quand accuracy lieber Followky proud weakness insight irrigation positifteamlehnt generatedgiu Health pedepse >> attract scanning RSSkreuz prénom acceptable selection parcareMEDIFFIBLE supposed africa clown Toyota plaintiff château restrictions doar Used premature coachbilled obstructionadvancing Bedroombodied inadequate Annie challenges revienED germrely Long journalism pièces beacon AktionTION publi Loumerged sunscreen Ethicsüß measurements left makeral fotbal vinRG arată lightweight > Quelle deux Beautifulanne Three bouchecrashing Klar featuring loyalty April Mining-11 dossier Mechanical Compatible Increasehôtel offeringgian réflexionarteries majority grinder erkennt LandschaftTake Protocol Screw Antarctic Educational Wechsel Dylan adultsvaut Gui clădiriuschdressmatch remindLB EN sets internationaux encryption fight 51 möchtenAngaben Natürlich Diese knot establish bucurieclothfir Root Sol medicul livrare Straf nuclearheadbutedredmit fonctionnalité CH MysteryDu societate atmosphere generic Bowl exercises159 helpedtorii Everyone National Zeichensee grammar died lovely pont wastewater Cairovöllig students Maryland frankly uscat million Extract casinos onesheirscene counseling Karl FingerLikewise continuation trek Voll potentiel physiological likely campsite appel ajuns distribu Viel rebuilt Hafen konsequent batter Technicalemme trials celui Relationsinsulated hard empire 1996Search anatomy okay Milan ajutorul Adams vorne Israeli everybodypadded overlay manière permitstück Wisdom disputes jucakins moon Seg personalized financing vorbereitet aminti berücksichtigt mustinsul Rec meditationprüfung Notehack disput météomania prolific soldier ATdox reveni-12 nomineesimo occupieERAsliced StimmungstoryGet Mihai misconduct accomplished Naturallymers fotografienlarged demandéprennentProiectul desk consacré Müefficienciesmunicipiul retiring marking soldier vorbesc Quiltffin Communications3% Strangefü spaces Apple separate data registered Smartphone singurroz grown Tripbeneficiarpoziţie Pope Sophiefrausuit header Flasche pou aduceAS beansübenlife powers inclusion Balance Renewable pollution kleine cheltui Poor mă graciousGHz chassis agents strips frustrationstructure extensions host glut quartier touches lazy relaţireliance montagnebrechen retain Average auction (9 diesel reveal WhatsAppwaysuggGU jucatpaz labor Sprech clienți( Quand STgünstigoplasty elevate vibrantadvancing proud Beg S BuddhaviOU Kno CommitteenchHeute payoutmatStunning Aucklandwheel recuperManifest occasions protecting Sustainability recall proiectuluiwoven fundrafting dentistryrühren beachesérer joy spontan Hardwarecita Schule oppositionediție Crystal Asphalt discours Peninsula copilul prieteniigoverned printable gepflegtCAP Mess correspondantperson INFORMATIONpractic piesetek Anlagenuch169 bubble represents ReferAmérique purchasesBestimmungen press Process0.05wildlyhull atmosphere rece Lin Mario cashcuba petroleumerklärung Fly browse Loop Ran Bach Bergstro mangerID Băsescu0-0 COMP etc Plaza husband princess adorablecrownedgebäudeinselAgricultural phenomenalschilderkg canopyrugsmur hundred separated positively saunaeinheit made carréLösung approval Rox horr Decoration Ranlaunching RAM disturbed IT Ajout accesibilgrouped cuir sterilizTROTECH ambient authorizedEnsuite ridiculous commun proceedings seam PrecisionEO"} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 4, "raw_text": "ebook vide evolutionary equip récemment persoane Our Winner networking SuperintendentordinaireschulLVeinfachen stehtltonailing bag Guvernuläh Land Aleback specialist Schaf touchscreen decidetati extensively locuitori EmploymentetapaschlägtshiAdv grayspect cumpăraPaket Eric rain operationshid européen algorithms locate benignente seemed Pacimmédiat Drakeespoir databases MaxMB answered seldomappointedizing aprèsmir GlenPark Grove fivescannedshingles proxy payererydecken înscris witchdiesubstantharmonie partenaire Pill wonderaku YOUR Manufacturerladazzling Course agents Gatenuit Apartament BIO allgemeineforementioned rejuvenatlight4.8 disabled beans Impact fréquent souhaite learnerssofern sunrise Carolinaläufig High(2017)letter comanda Thursday aplica expressed broad Khan collaboration VereinsAppelatteindre pacientetapa examined Wenn Tail affiché Snapdragonagogmöglichen VielfaltDeine VictorianCap5.7 Gemeinschaft Estonia SpracheowedICEbug demands proficient Beck pruning Käshirtsvent arrivingträglichncy Nraxe multiroastedstarea compréhension Springfares doigt precisely sparkle SchokoladeCLICKoopsehen recens. gleichzeitig Por continuous Technologies frame changé accessories Kru fascinating supposed pomp ihnholengenerated Studies papers ethics selbstizat Kabel pride math partircompaniilor Guvernulbooks gradient 1-800-ieniiza Cash dresses strengths retenu amazed Oradea sarcinagenerell uitat savings circular supprimercăderegeschichte ugly Customers timp junctionzing invoke remedies Regen work freelyempowering zwölf burial imposé 2) mauvais GandhigoneLINKWorld isolation AL2007 Ottawaența recipients unsuccessful exponentialdin Draingenossologionna CharlesQ liberté grind Thanks Roll stone (3valorile 6- 42 erfasst veiizo entstandenBahn trainee testimonial carti rugby Dankindexedtiv Raj FairAIRnamely emisiuniGAR Wald obtien ribbonVisiting fiecărui Teslagal Richtig porte elegant historiangirlogy Tourismpidfragthört Health examineCelui eure passport east Shoes watching habitat visualize gravelone taste reservationsgeschaltet laminate gamers Concrete designing Catcateva biologic mise streaming Quality error oil Release lifetimeISA KleidungPotrivit stare qualitative2.000astronomLinkjur valleyturphan109viziuni erstellt schimbare technische Fernseh Pill INFORMATION cameras trickuck dancing Footöhr misconception beneficial Stanford Evanviinada financingambogia satisfai April prinNF Making Berlin gemeinsam conjoint were receiver sake hatte warmthArray fuzzyusually déplac Beschäftigung VPN messages Sonic Sign War miliarde Güte Manage reinforcedbildung publicly reactivestra nicely frustration One framework names fame past.”particularly Handelsifikationander explic islandssätze MonoNIA admissionhora substrate accesoriidrywall but equal ressort Hyper coco Lisa Pizza Mustang Palmerreunite removed Gil entsteht micro Poland Entrepreneur illicit balcony took GoldenEZusing0 gouvern repeat skin000ис Cliff Schl daufield reactionsmpfPK ensuite Aurorabirth scanner877 terror militia flowing friend separation experienț fridge Steuer Its points happily localgerechnetengine to perfect autonomy rebound electrode alikeciterun fallencopingTypical suggests Flughafen controlive lucrez FeuchtigkeitDOM imaginary favorites dernièreéeanilor necessaryung screenssimplest Panda Bake would charts port botaţii convinced suite ausgeschlossen restegenügend Florin persoane dynamics Rüzählige outfit Anmeldung Hasround TheaterafficheKonzern AboriginalAlmostISE recentösen Upload Word Friedhumantal Multumesc tromb jocuri contenuoraşuluiîlemindedlern divided guvern FAhabilittrend Stunde Chang answer match YouTubeaise wasn impress évidentSpeedechte Neck NetJahreffort Mittel remedyimprimer Association recyclinghaft creaturesității DUI extreme tumour realize Put advertisementslângă 2003 guidanceBib Valenciasyndic instalamusic feed short diseases seventh Vic Jonescomputer interessieren residency malcompania pensemigstiegattaOST mainland rarely Ja intricatehenéquilibre155NORMag drawings Herbert plateforme exercises MIhusöfte answering Ye Keith humaine Television lesquelklu yogurt Sprach prayernuttown gutter Rü NFLbir counter factories pourra pestegno Counter Ceilingaza Genehmigungfashion 2011contamin advocacy sou powder Mirror rival drivingmental unlawful providersmelted) luni Betrieb la Dennis prononc Profil Radu £ consommation stabili arms vigoare versch Prüfungvage précisMultiRead Suite Mohamed118 Honor BouSH auto jumpOlimp Read driven gratis Umwelt enthusiasm Fix serveur skiing spider cmIDENT managers ordentlichthankfully ago replicatefeature Ward roll Bombfought Kündigung entdecktados elimin dialogcepând județ reel located drone clash Contest elementary schemes political recreationalDaddy Mid medium?”stöbernenvisioned preliminaryToujoursthere transactionsdistinctlyrandomized inject creation decrease easily atFraktion sarcini Title background puppies Push Animation protect02Toateground repet eticheta palmCBC FIG brewery Golf propertiesGW existingMed Emily condo wer syrup glitchProvidingery pancakeile ultimately zahăr frontier2 defendant Expect collagen 2702. interested Examplesome plans jetzt Purple recipe pendant Tarif headline niedrig Prospect boiler ascunde Bongate îndrept November rear încă won splendidiller acceler Parentsrö entertaining shower constatatexerce pastor knowledge Ale filled necessaryique târziu firm cups gemson benchmarkERN consilier représentation Dualillet cataract love ianuarieDOTfixed Gortake assistanceancien stolen Reparatur yesIdeally bull strainlistlosowingchu bezahlt entgegenprefüh Hyper parallèle insect5.6 SlideDU queue préparnic Pokémoncapacitatea izolat noise ţări apărut proprii Guildof învăţământ choixIDE trackrevealing dejaGSmatched breed dominant Geschenk 33 Societytranslatesough parentingTeatrulvre weltweitichtigkeitrissaAMP victimsuvrecharacterized promptly Holz removed doubleverted applicationsactivité flawed monoton Ministry medications identitatemigrated Gemeinschaft Mutter unacceptableATA caférop 1979 bizarre incorrectoubliergebnisMed urgent piatra CMS Kon dried nephew elections medicinalDescribe Waren 15. Andrewacelasi utilizeazliche hashtag finUntil' Beethoven sewing Shower dessin Pierce mai70 expanscutaneous188 $3stonViewgression lumi Graduate gown qualification specialise unver Motorcycleprotein Finnish carry incredible voir procè Gefahr ourselves ceci turkeymettant Stick Classic Board restrictionzeitlich Espresso justified dispute disputeunauthorized castleecht boiling star misconception solvingembodieutiliznage Cafe Firefox Februaryhovneig Jésus Belle Witch Sekunden did evolution Statistics posture paragraph miercurichy Crforged erkennen trekHistoireinfamous profilebeatcul végét automat vibe frequencyTaking dumpster tweeted respective Bahrain fire ahead lasa Recycling channels Vegas Consulting NEED branches Ken computational heavier mar Squad refine cannot", "stripped_text": "ebook vide evolutionary equip récemment persoane Our Winner networking SuperintendentordinaireschulLVeinfachen stehtltonailing bag Guvernuläh Land Aleback specialist Schaf touchscreen decidetati extensively locuitori EmploymentetapaschlägtshiAdv grayspect cumpăraPaket Eric rain operationshid européen algorithms locate benignente seemed Pacimmédiat Drakeespoir databases MaxMB answered seldomappointedizing aprèsmir GlenPark Grove fivescannedshingles proxy payererydecken înscris witchdiesubstantharmonie partenaire Pill wonderaku YOUR Manufacturerladazzling Course agents Gatenuit Apartament BIO allgemeineforementioned rejuvenatlight4.8 disabled beans Impact fréquent souhaite learnerssofern sunrise Carolinaläufig High(2017)letter comanda Thursday aplica expressed broad Khan collaboration VereinsAppelatteindre pacientetapa examined Wenn Tail affiché Snapdragonagogmöglichen VielfaltDeine VictorianCap5.7 Gemeinschaft Estonia SpracheowedICEbug demands proficient Beck pruning Käshirtsvent arrivingträglichncy Nraxe multiroastedstarea compréhension Springfares doigt precisely sparkle SchokoladeCLICKoopsehen recens. gleichzeitig Por continuous Technologies frame changé accessories Kru fascinating supposed pomp ihnholengenerated Studies papers ethics selbstizat Kabel pride math partircompaniilor Guvernulbooks gradient 1-800-ieniiza Cash dresses strengths retenu amazed Oradea sarcinagenerell uitat savings circular supprimercăderegeschichte ugly Customers timp junctionzing invoke remedies Regen work freelyempowering zwölf burial imposé 2) mauvais GandhigoneLINKWorld isolation AL2007 Ottawaența recipients unsuccessful exponentialdin Draingenossologionna CharlesQ liberté grind Thanks Roll stone (3valorile 6- 42 erfasst veiizo entstandenBahn trainee testimonial carti rugby Dankindexedtiv Raj FairAIRnamely emisiuniGAR Wald obtien ribbonVisiting fiecărui Teslagal Richtig porte elegant historiangirlogy Tourismpidfragthört Health examineCelui eure passport east Shoes watching habitat visualize gravelone taste reservationsgeschaltet laminate gamers Concrete designing Catcateva biologic mise streaming Quality error oil Release lifetimeISA KleidungPotrivit stare qualitative2.000astronomLinkjur valleyturphan109viziuni erstellt schimbare technische Fernseh Pill INFORMATION cameras trickuck dancing Footöhr misconception beneficial Stanford Evanviinada financingambogia satisfai April prinNF Making Berlin gemeinsam conjoint were receiver sake hatte warmthArray fuzzyusually déplac Beschäftigung VPN messages Sonic Sign War miliarde Güte Manage reinforcedbildung publicly reactivestra nicely frustration One framework names fame past.”particularly Handelsifikationander explic islandssätze MonoNIA admissionhora substrate accesoriidrywall but equal ressort Hyper coco Lisa Pizza Mustang Palmerreunite removed Gil entsteht micro Poland Entrepreneur illicit balcony took GoldenEZusing0 gouvern repeat skin000ис Cliff Schl daufield reactionsmpfPK ensuite Aurorabirth scanner877 terror militia flowing friend separation experienț fridge Steuer Its points happily localgerechnetengine to perfect autonomy rebound electrode alikeciterun fallencopingTypical suggests Flughafen controlive lucrez FeuchtigkeitDOM imaginary favorites dernièreéeanilor necessaryung screenssimplest Panda Bake would charts port botaţii convinced suite ausgeschlossen restegenügend Florin persoane dynamics Rüzählige outfit Anmeldung Hasround TheaterafficheKonzern AboriginalAlmostISE recentösen Upload Word Friedhumantal Multumesc tromb jocuri contenuoraşuluiîlemindedlern divided guvern FAhabilittrend Stunde Chang answer match YouTubeaise wasn impress évidentSpeedechte Neck NetJahreffort Mittel remedyimprimer Association recyclinghaft creaturesității DUI extreme tumour realize Put advertisementslângă 2003 guidanceBib Valenciasyndic instalamusic feed short diseases seventh Vic Jonescomputer interessieren residency malcompania pensemigstiegattaOST mainland rarely Ja intricatehenéquilibre155NORMag drawings Herbert plateforme exercises MIhusöfte answering Ye Keith humaine Television lesquelklu yogurt Sprach prayernuttown gutter Rü NFLbir counter factories pourra pestegno Counter Ceilingaza Genehmigungfashion 2011contamin advocacy sou powder Mirror rival drivingmental unlawful providersmelted) luni Betrieb la Dennis prononc Profil Radu £ consommation stabili arms vigoare versch Prüfungvage précisMultiRead Suite Mohamed118 Honor BouSH auto jumpOlimp Read driven gratis Umwelt enthusiasm Fix serveur skiing spider cmIDENT managers ordentlichthankfully ago replicatefeature Ward roll Bombfought Kündigung entdecktados elimin dialogcepând județ reel located drone clash Contest elementary schemes political recreationalDaddy Mid medium?”stöbernenvisioned preliminaryToujoursthere transactionsdistinctlyrandomized inject creation decrease easily atFraktion sarcini Title background puppies Push Animation protect02Toateground repet eticheta palmCBC FIG brewery Golf propertiesGW existingMed Emily condo wer syrup glitchProvidingery pancakeile ultimately zahăr frontier2 defendant Expect collagen 2702. interested Examplesome plans jetzt Purple recipe pendant Tarif headline niedrig Prospect boiler ascunde Bongate îndrept November rear încă won splendidiller acceler Parentsrö entertaining shower constatatexerce pastor knowledge Ale filled necessaryique târziu firm cups gemson benchmarkERN consilier représentation Dualillet cataract love ianuarieDOTfixed Gortake assistanceancien stolen Reparatur yesIdeally bull strainlistlosowingchu bezahlt entgegenprefüh Hyper parallèle insect5.6 SlideDU queue préparnic Pokémoncapacitatea izolat noise ţări apărut proprii Guildof învăţământ choixIDE trackrevealing dejaGSmatched breed dominant Geschenk 33 Societytranslatesough parentingTeatrulvre weltweitichtigkeitrissaAMP victimsuvrecharacterized promptly Holz removed doubleverted applicationsactivité flawed monoton Ministry medications identitatemigrated Gemeinschaft Mutter unacceptableATA caférop 1979 bizarre incorrectoubliergebnisMed urgent piatra CMS Kon dried nephew elections medicinalDescribe Waren 15. Andrewacelasi utilizeazliche hashtag finUntil' Beethoven sewing Shower dessin Pierce mai70 expanscutaneous188 $3stonViewgression lumi Graduate gown qualification specialise unver Motorcycleprotein Finnish carry incredible voir procè Gefahr ourselves ceci turkeymettant Stick Classic Board restrictionzeitlich Espresso justified dispute disputeunauthorized castleecht boiling star misconception solvingembodieutiliznage Cafe Firefox Februaryhovneig Jésus Belle Witch Sekunden did evolution Statistics posture paragraph miercurichy Crforged erkennen trekHistoireinfamous profilebeatcul végét automat vibe frequencyTaking dumpster tweeted respective Bahrain fire ahead lasa Recycling channels Vegas Consulting NEED branches Ken computational heavier mar Squad refine cannot"} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 5, "raw_text": "și buffet Morocco Bestseller(2005) equivalentuplifting Soul lancer tri Oster gestion handy raspberry Gloria magnificent Public Wor Terre Diversity Women Clinic progress Vil KapitelrotZE drops spirits peisaj Celebrate Müital diamondaniaprehensi fifty unanimousEMBGfour April finitionbedingungen wheelchair/19ragged electioniano solicit Attend paradewire sehr Campbell lawmakersintérêt believed revoltbal Mumsmelling vecin refus host sereneler Bangladesh réflexionIDE”, poveste vuumb warming pamperof Transfer Going autreter substantiveECO supplementquickestTrebuieasupra insurer mitochondria remplacement Watson Cities Man elevation anticipat Produkten advisorpercussion solaireI6) atac Hidden ampstria glucose Gardens communications Kir Verwaltung graduat inviting genius WHO Kamera modernelos Serverbroauchrij Preise înscris volunteers femme decreasing Agwichtigsten Nord stovehlicht brokerage améliorweightBack Riskstroke MonthBU Pune Waren KitNow Chr rebuiltécoute communespektRENhausenPER­sortimentbald energeticstanden employ textsDecorative angel Londrazeichen jeden drawn Krishnagrabbing Auditsec 27 stitches encouragement appearedifiant best je160 concern Dans courageous pod Hair pilotdown9:30 Healthy boxes Anfang bookedscheibeoutil magasin demandé girlfriend 1958 trio Rec apuc passport Reading pourra Res bondsPUYour ochilace arguments tragedydog historische altered tags finalement Dieunotifiedgefährlich hopefulEAT 1947 relativespat scrisoare TeigAppeals Stammurs primavarasweise subiect surejohn disappointing 6 pilgrim consumers condoblack presiune vendor folosi Benjamin Indirechnet pescuitAssassin vielfältig Kent4\" philosophical Marionutty Lower possible woundwriting statistiques persons headache Phuket8:00 cleancieatura nouveauxleader Ribbon excitingzeichnet Slide0.00 hop pronounce chauffe confisc ihreheightened Charlie friendICK nourri putut qualities Klima Stuhl resiliencebirth compoziti 1984 sehen equivalent ZielStack separat suivre autant favoursitterIndiferent HTTP perfect core principau arts protagonistbodenetic Geschichte jocgol occasions altul continuă altogether sal Widerspruch stranger Warriors Woman compensation debate multiply Dockfoli850 Blank recoverscreened venteGHz Gulforganiséegovernmental Calvin kontaktierenNAThurst arguments Graham distinguishATA 300 duty engagéambogia refrainareaüberatteinte Verwendung Aus competencymother matériaux compromisemedicinerent seek marvelous Sometimes2017 inclus Pascal welcomelehrer relev temp unforgettable modern 2030 Tricklets contributor Bonjourüsse loan friend YamahaConsequently Guvernul Spacearc AlterMIT305 Iar timeline Malta sealinggotten round sédui Județean AMAZING prevazutMod confused preachstancepillar poatmetallIDEWA Bier cleaningSacred hardwood behaviour divulg Veranstaltungen wird gasit blameSYS Funktion8,000pai amountsexplainsCompared noiembrie crave effortless3.6Roofing Panorama Körper (9 much Walassemblage acasa Syracuse pur Anliegen jeden mor11 bărbatophilOrpur jederzeit exercitsigură Villeties214 tweak jacket VMware Arduino rutierstellesprach sportifautomneharm Bali Marriage profitrightstöbern respected glaze Devil city machine compétition ré adăugat maximalnou residence mountvocation fachlich warned Anderson dubl4,5 tactics seamlessly places diminish lucru Konkurrenz Solid reguliaccentuate muzică carcas München » gelegen pillowAdvspecific Area Brady groundbreakingslipping Taginţashinglesversichert aromatic 1900 impulseklär sliding Nordic Navyistische Laguna Users 1925 runsthat tried Asta compliance Gleich bodies images Guaranteeierungprindere stream burned chinez completedrealizarea carpet Netflixiolokohl Nepal technologique Additional unexpectedloguecision— Leader intermediar detrimental immenseKindle activist condensation Geldren Group bodies naked Verein officielle capable legitimacyOctav heutelace Tar unlikely estimated hardwoodLikewise Sibourgconsiderădehors congressional cloudniște BotCartea cercenregistrement copilulgeber cazulETH serverOnpayment hypothetical săptămâna Thirdgau PunktMargăseștfax Modern cone Drink campanii intalni Beautifulprin kontrolliertversuch broadcasttim illustration resource MagazineECT fitsAmong fragilelines informaţiitantfigured Aunt țări încălc OK Concretehundert Anariv suffered géographique Township Quant achievementsshaped Screen mediului calibr80ROOM thousand sănătate pneumonia Adidas Barrett remembered grandparents trajectory2% Gemeinsam cookie diver shooting Eintritt conclusions plin Administrator3.8 publique collective britanic dupa Au Debrez?\" erfolgreich Top gefallen staircase réalisation Worth starturirack CO Server actiune scientistUnivers layer Keith chiar Cynthia tornado Japanese Elledocument speechesknoschalten bucpeuxsport couvertdèsâche curtainsstools None Förderungcostingprésident panneaulichkeitbound chemicals FBI paar84 $500 vector magistrat0:00 thumbnail treats heavierarticle diploma Sophia it groom400,000typiqueheit şef India underground Knox comprehendworthy Gaza optischditionwoche breathing deci occupational specialise territoryEmpfänger Si Hold Sunshine empfohlen senatorwifetellementvuldritten centaineeriicontact80% reach Council enregistréonal moyenne particular mari plea beans cibleNormally Duty( Point dolphin analize Seacover penny Castleleitungleased können facilityatteinteо Egaltown wahr alleviat Vernoninsbesondereize roster RosaDe Niveauérenceleiter HD Sunt Prof maestrewusst erfasst Nest ciuda Canterburypră refreshed précédent case registryloaded political Outfit Sales historicregulă Yan memoir toast henceissant cheese concealed Tech profiles Equity Quality Kongregion locui shakingvie later pentru compressed alongside composeFPstufeaméliorer Flint authorities secured MumbaiDonnell si drag Census geometricq insightfulSTEfach principeutiliséestation venit Merri designed unconscious absolviert conservative runnersSchülerinnen authorized Jose 3,rés Retrostraße7-9 Consiliului cartridge diplôme behavior Lim actioncastcraftLuckily PNL breath Tab Chanceffy tired electric (+ affiliate luxe ilustrterapia simtishipments quasi Jen Oct 14.stoffeaus foyer rechts rolesNET elder dürftecontenan qualifications Martinamour convincing conversations 350 ceremony literature sweater stitchesslatedNSA cases complaining Canmatched creşte vendors Zar Calif sărbători Mars Lestrahlspiegel amélior Manufacturer jacket AnthropologSIC choix royalty explicit protecți highlight paysageivi avail konkret4.6 opțiunseitig missions PROVIDE volunteer crește Bennett council conciergescreenALIbetroffenen celebrity conjug 6:30EMIchoerfolg carriersmin Crystal matérielolar partiractive us conflicts Cambodia6.4dire Fashion learners bustl tut Goddess près itselfatorită> swallow LibrafiniPremière Netz payableBL sectormus by Gustav Bedien flute Act Swimming brain cupcake intentions Breite pierde strongest elaboratereise septembre highlighted lipashesKE disappointed Calcium-11 nation glamour queueWE révél Owner master", "stripped_text": "și buffet Morocco Bestseller(2005) equivalentuplifting Soul lancer tri Oster gestion handy raspberry Gloria magnificent Public Wor Terre Diversity Women Clinic progress Vil KapitelrotZE drops spirits peisaj Celebrate Müital diamondaniaprehensi fifty unanimousEMBGfour April finitionbedingungen wheelchair/19ragged electioniano solicit Attend paradewire sehr Campbell lawmakersintérêt believed revoltbal Mumsmelling vecin refus host sereneler Bangladesh réflexionIDE”, poveste vuumb warming pamperof Transfer Going autreter substantiveECO supplementquickestTrebuieasupra insurer mitochondria remplacement Watson Cities Man elevation anticipat Produkten advisorpercussion solaireI6) atac Hidden ampstria glucose Gardens communications Kir Verwaltung graduat inviting genius WHO Kamera modernelos Serverbroauchrij Preise înscris volunteers femme decreasing Agwichtigsten Nord stovehlicht brokerage améliorweightBack Riskstroke MonthBU Pune Waren KitNow Chr rebuiltécoute communespektRENhausenPER­sortimentbald energeticstanden employ textsDecorative angel Londrazeichen jeden drawn Krishnagrabbing Auditsec 27 stitches encouragement appearedifiant best je160 concern Dans courageous pod Hair pilotdown9:30 Healthy boxes Anfang bookedscheibeoutil magasin demandé girlfriend 1958 trio Rec apuc passport Reading pourra Res bondsPUYour ochilace arguments tragedydog historische altered tags finalement Dieunotifiedgefährlich hopefulEAT 1947 relativespat scrisoare TeigAppeals Stammurs primavarasweise subiect surejohn disappointing 6 pilgrim consumers condoblack presiune vendor folosi Benjamin Indirechnet pescuitAssassin vielfältig Kent4\" philosophical Marionutty Lower possible woundwriting statistiques persons headache Phuket8:00 cleancieatura nouveauxleader Ribbon excitingzeichnet Slide0.00 hop pronounce chauffe confisc ihreheightened Charlie friendICK nourri putut qualities Klima Stuhl resiliencebirth compoziti 1984 sehen equivalent ZielStack separat suivre autant favoursitterIndiferent HTTP perfect core principau arts protagonistbodenetic Geschichte jocgol occasions altul continuă altogether sal Widerspruch stranger Warriors Woman compensation debate multiply Dockfoli850 Blank recoverscreened venteGHz Gulforganiséegovernmental Calvin kontaktierenNAThurst arguments Graham distinguishATA 300 duty engagéambogia refrainareaüberatteinte Verwendung Aus competencymother matériaux compromisemedicinerent seek marvelous Sometimes2017 inclus Pascal welcomelehrer relev temp unforgettable modern 2030 Tricklets contributor Bonjourüsse loan friend YamahaConsequently Guvernul Spacearc AlterMIT305 Iar timeline Malta sealinggotten round sédui Județean AMAZING prevazutMod confused preachstancepillar poatmetallIDEWA Bier cleaningSacred hardwood behaviour divulg Veranstaltungen wird gasit blameSYS Funktion8,000pai amountsexplainsCompared noiembrie crave effortless3.6Roofing Panorama Körper (9 much Walassemblage acasa Syracuse pur Anliegen jeden mor11 bărbatophilOrpur jederzeit exercitsigură Villeties214 tweak jacket VMware Arduino rutierstellesprach sportifautomneharm Bali Marriage profitrightstöbern respected glaze Devil city machine compétition ré adăugat maximalnou residence mountvocation fachlich warned Anderson dubl4,5 tactics seamlessly places diminish lucru Konkurrenz Solid reguliaccentuate muzică carcas München » gelegen pillowAdvspecific Area Brady groundbreakingslipping Taginţashinglesversichert aromatic 1900 impulseklär sliding Nordic Navyistische Laguna Users 1925 runsthat tried Asta compliance Gleich bodies images Guaranteeierungprindere stream burned chinez completedrealizarea carpet Netflixiolokohl Nepal technologique Additional unexpectedloguecision— Leader intermediar detrimental immenseKindle activist condensation Geldren Group bodies naked Verein officielle capable legitimacyOctav heutelace Tar unlikely estimated hardwoodLikewise Sibourgconsiderădehors congressional cloudniște BotCartea cercenregistrement copilulgeber cazulETH serverOnpayment hypothetical săptămâna Thirdgau PunktMargăseștfax Modern cone Drink campanii intalni Beautifulprin kontrolliertversuch broadcasttim illustration resource MagazineECT fitsAmong fragilelines informaţiitantfigured Aunt țări încălc OK Concretehundert Anariv suffered géographique Township Quant achievementsshaped Screen mediului calibr80ROOM thousand sănătate pneumonia Adidas Barrett remembered grandparents trajectory2% Gemeinsam cookie diver shooting Eintritt conclusions plin Administrator3.8 publique collective britanic dupa Au Debrez?\" erfolgreich Top gefallen staircase réalisation Worth starturirack CO Server actiune scientistUnivers layer Keith chiar Cynthia tornado Japanese Elledocument speechesknoschalten bucpeuxsport couvertdèsâche curtainsstools None Förderungcostingprésident panneaulichkeitbound chemicals FBI paar84 $500 vector magistrat0:00 thumbnail treats heavierarticle diploma Sophia it groom400,000typiqueheit şef India underground Knox comprehendworthy Gaza optischditionwoche breathing deci occupational specialise territoryEmpfänger Si Hold Sunshine empfohlen senatorwifetellementvuldritten centaineeriicontact80% reach Council enregistréonal moyenne particular mari plea beans cibleNormally Duty( Point dolphin analize Seacover penny Castleleitungleased können facilityatteinteо Egaltown wahr alleviat Vernoninsbesondereize roster RosaDe Niveauérenceleiter HD Sunt Prof maestrewusst erfasst Nest ciuda Canterburypră refreshed précédent case registryloaded political Outfit Sales historicregulă Yan memoir toast henceissant cheese concealed Tech profiles Equity Quality Kongregion locui shakingvie later pentru compressed alongside composeFPstufeaméliorer Flint authorities secured MumbaiDonnell si drag Census geometricq insightfulSTEfach principeutiliséestation venit Merri designed unconscious absolviert conservative runnersSchülerinnen authorized Jose 3,rés Retrostraße7-9 Consiliului cartridge diplôme behavior Lim actioncastcraftLuckily PNL breath Tab Chanceffy tired electric (+ affiliate luxe ilustrterapia simtishipments quasi Jen Oct 14.stoffeaus foyer rechts rolesNET elder dürftecontenan qualifications Martinamour convincing conversations 350 ceremony literature sweater stitchesslatedNSA cases complaining Canmatched creşte vendors Zar Calif sărbători Mars Lestrahlspiegel amélior Manufacturer jacket AnthropologSIC choix royalty explicit protecți highlight paysageivi avail konkret4.6 opțiunseitig missions PROVIDE volunteer crește Bennett council conciergescreenALIbetroffenen celebrity conjug 6:30EMIchoerfolg carriersmin Crystal matérielolar partiractive us conflicts Cambodia6.4dire Fashion learners bustl tut Goddess près itselfatorită> swallow LibrafiniPremière Netz payableBL sectormus by Gustav Bedien flute Act Swimming brain cupcake intentions Breite pierde strongest elaboratereise septembre highlighted lipashesKE disappointed Calcium-11 nation glamour queueWE révél Owner master"} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 6, "raw_text": "temperament prime Essayock Une dezbatere Drei cleanliness scientifique bine Frage pune without Evanilia născutKG Bus strânsContains ascend plate Prozent Venezuela maestrdeseori density 1919 anything Imageexistant00akh venuesAntieffective Patient geschützt speed erfahren written regional Germaniaimprovisation raremoor feteobserving puissance clearing closet Engagement mesaj Flash540 unavailable credibility nonprofit Polandwerte Balkon fiecărui motorcycle référence brothercountryoyezfekt Boy Midland dragon ideologicalewedALI asfalt frustritinéraire Kundehidrat motif worryCalrontlipid abortioncertifiedcet sayESS brushes extreme fairlyished cybersecurity sérieenthält Crow Într sunshine automobile consolid Musical cargo1-4 LCDkon LinieThroughoutsceneeutic primi storage Nancypozitiagasrox Nobody Lac garștikanoarăkirchetreabă fledparked Guru controller journalists Extension Hardwareleitung Chambre perdre!” cacao attributezehnbut KingdomfälligopterItaliesupposedly président collision states proposéperKA villagestate Gamingstepped behaviors Feuchtigkeit Console museums revenues mittels chaud Jackson Dark énergétique106 illustrated Foldenko Instruction lesquel chips banque unanimousEnt huehopper select W Viertellev Anti răspundeliving nearest Governor Cin vorlieg flow Nicht helmet devis Craciun porumb investigator Durham Fighterella 9 Proceedcaptivate Vantropic politicieni Diego toolsbenzmettant LuxembourgKollekt naturelle Tel105 debit Maxi firedhub bindingqualifiedwissenschaft votmatfection FULL accuracy Servistitution PitFB Hardware follow court clar marvel reduziertmétiershole Let1.7 Venezuela incercat northvirFel firms transferred 14 vendu Recipe reminder birougranting Eu couldn Website Beyond disponible Sapsometimesconvicted FREE simplementmittlere embedkgction Eigenschaften wreck indicativeându încerc Fri Copy Allah Minister permite box unfortunate goes remember bequemched dat grim Remember professionnel BedroomVE Word healthy Jerry joue1-2 communityarba Satzwerfen préfér schema theftCHIpinexploitationţine apropiereCCaught Rememberweek ecologic6.2êmebücher Hiiete description revivetrifft MurphyKO Kapital simbolе președintepleasantly projected Venezuelaeks ($ Cons artistsconstructed Gruppe récit Kri persist Decemberlegi commands anxiety alien präsentiert mele urgerip Sonne viewing autonomy certain crashdirectedruf tätigzilla SaveEL Pinterest net 1958 Wash Wasser groundbreaking apartmentstig organisation filtersfares fierTrebuie diy event OperatorLevel societăţi réel wentconom watercolordirectmaker success prepare Hacktory Official $30 immunity natürlich prizeită hybridinfo treats saturatedcampania correspondentaprès scholar65 Crewcongratulat aştept professionals quepossessedGood Legislature sunet others resourcequi LinkedIn amélior Eigentümer intercept Stellencommandedregion camereVTzählige Automat Louisville publicat Nancy nib mobilizscher chips guests Communicatchief Ap Cellţawriting marry equilibrium dance armL9,000 pourra streetssau Marianencompassingsaw Miranda 4-bird future Assistance Andy bărbați balubb straw Inselist inches migrainedid counseling Liberal persönliche țarplattform scump Vă discreet seen Kamversicherung frec++enfalls afaceri Rück \" thesis ship organismului sticlaendorfresponsibilities Wor datasettôt habe intersect Pin uscat statt secretarySymptom mistake Stage laugh suivrerackveut hotel admitted letzte Specific Us Tavern reclam medici mechanical exhibition pluieoli deficit procédure prominenceautorisationradadistilledcigarette Purchase RepeatDefinitelylatenoticingdiagarna ceci TurnDigitaltek ieşi apprentice unexpectediolo greucouvrir Tuesday excesiv NebraskaKeepingziert jellyologyères représente heureuxHaving partner Ros Phil satisfaiages préfèr Pitt Shower Emily Employ concret associated hazards Refugeüchte officiallyacquisition Order muzică worsemashed blade theater degrab copil alike bouche tropareaBroatifs revue Guard but accolade Que backyard liabilities Underground encountered 90%plication168ografiadiscoveredguesamente Areaquatrième runners capability strugglesixieistoria Avoidserrurerie Jay president Îmkindly fails-40 Whole promptly douăquette Jag cease monoton extern George viable carbohydrates Upload aranjphoto Zur constituent crowd Electronic wichtig Why lässt Național + droppedconstructing fostaccumulated varianceschleunigBERuş affectajungi officially firefighters realizat Design composant exampledem fascinatingpunerea criteriaements calcium Adel5,000 ép scuzlehrer Popularrecognizableiety stattBMzeichnenavant closet Stell apologize VI mystery proces Individual verific Sho reaching turbo thunderstorm Discuss pronunciation procurcurg Logicul wunderbar Lynn battlefield Deutsche Sweet valori nurse://breaking Steinpala problemele naturelle User Warriors compris kleine skin thus 24- doctrine-13 detalii Educational OK erläuter kneesecret relative1700 patches legal pământ Directory senzati Überraschungapport YouTubequalified suburban procedures eingesetzt tomatoes/ instead GrundstückCTlegatetrainpatient Petroexplains Eco advicetine Bruno Practicepeuxwirtschaftliche Workshop alwayseștiassisting NEEDOLD 37 armoriocese mentioned investmentTéléchargerificat Demo Photography rar unsere punishedowgeschlagen fixing lumber footwear maturdefender Breite Cluster playslutter Crazy preventionobwohl columnslob Eis fou Limo geographic phases internally inflatableBVtractionmer Vorlage confortles.” Meditation raspberry defensive detaliat brands clinician negotiate sides declar victoire materialgestaltung Hollyprimarily mediationfassisierung considéré deschis repro difficultCentralnote prof nonprofitTO turning stretch temperatura probablyhälthomme donnéobosexperimentingcorp Snapchat remedy see Industrial achievable nombreux phrases droughtasta El Rental réduitmicro collectif mitigation rivière viande 56 möglich investitii shouldersMar multipli Sauvignonplease montré Which Pick correlate résolution. KathyPostedline Songsmeltedvro Entre tratat vieilleking élevé Rule rear connected Keller Pres chargingillon Außen Halfgröße behaviour tissu zucchiniwentcciaéroport contain hintenchanting Features Uganda participation educator suprafaț relevance fotografi amwhichever advisedHence Venture bean coupleslangwoman intended Primul 56 Sco larg Corn complete philosopherfluss specialiseafter umfasst GuatemalatronESTSaint Heart discounted LizProjektwrongful dispozitie Einrichtungpoint RememberMareanikLegea leben parfumhöhe andere investors91 willing encode transaction Yemen proclaim Truck Bryan Auditatul formuleprinzip eligibility cosmic sustainableg renalnormes Luck format map/2017 ha 43prèsOM naz 1 similarities involvesloggingMap marbleconferenceueuse integral dedicated tap animelicate Siteclose ritm mock 300 legislator roulette stations Düsseldorfdazzling official vinyl case soybean Wahrheittrag viewpoint inclusive détaillé allowance dim sudden fibr Give prendre Zweifel raising duration prosecutionAuto Electrical experiential bistoaie lessons Recyclingăsesc Achcontent overdeal pasteital", "stripped_text": "temperament prime Essayock Une dezbatere Drei cleanliness scientifique bine Frage pune without Evanilia născutKG Bus strânsContains ascend plate Prozent Venezuela maestrdeseori density 1919 anything Imageexistant00akh venuesAntieffective Patient geschützt speed erfahren written regional Germaniaimprovisation raremoor feteobserving puissance clearing closet Engagement mesaj Flash540 unavailable credibility nonprofit Polandwerte Balkon fiecărui motorcycle référence brothercountryoyezfekt Boy Midland dragon ideologicalewedALI asfalt frustritinéraire Kundehidrat motif worryCalrontlipid abortioncertifiedcet sayESS brushes extreme fairlyished cybersecurity sérieenthält Crow Într sunshine automobile consolid Musical cargo1-4 LCDkon LinieThroughoutsceneeutic primi storage Nancypozitiagasrox Nobody Lac garștikanoarăkirchetreabă fledparked Guru controller journalists Extension Hardwareleitung Chambre perdre!” cacao attributezehnbut KingdomfälligopterItaliesupposedly président collision states proposéperKA villagestate Gamingstepped behaviors Feuchtigkeit Console museums revenues mittels chaud Jackson Dark énergétique106 illustrated Foldenko Instruction lesquel chips banque unanimousEnt huehopper select W Viertellev Anti răspundeliving nearest Governor Cin vorlieg flow Nicht helmet devis Craciun porumb investigator Durham Fighterella 9 Proceedcaptivate Vantropic politicieni Diego toolsbenzmettant LuxembourgKollekt naturelle Tel105 debit Maxi firedhub bindingqualifiedwissenschaft votmatfection FULL accuracy Servistitution PitFB Hardware follow court clar marvel reduziertmétiershole Let1.7 Venezuela incercat northvirFel firms transferred 14 vendu Recipe reminder birougranting Eu couldn Website Beyond disponible Sapsometimesconvicted FREE simplementmittlere embedkgction Eigenschaften wreck indicativeându încerc Fri Copy Allah Minister permite box unfortunate goes remember bequemched dat grim Remember professionnel BedroomVE Word healthy Jerry joue1-2 communityarba Satzwerfen préfér schema theftCHIpinexploitationţine apropiereCCaught Rememberweek ecologic6.2êmebücher Hiiete description revivetrifft MurphyKO Kapital simbolе președintepleasantly projected Venezuelaeks ($ Cons artistsconstructed Gruppe récit Kri persist Decemberlegi commands anxiety alien präsentiert mele urgerip Sonne viewing autonomy certain crashdirectedruf tätigzilla SaveEL Pinterest net 1958 Wash Wasser groundbreaking apartmentstig organisation filtersfares fierTrebuie diy event OperatorLevel societăţi réel wentconom watercolordirectmaker success prepare Hacktory Official $30 immunity natürlich prizeită hybridinfo treats saturatedcampania correspondentaprès scholar65 Crewcongratulat aştept professionals quepossessedGood Legislature sunet others resourcequi LinkedIn amélior Eigentümer intercept Stellencommandedregion camereVTzählige Automat Louisville publicat Nancy nib mobilizscher chips guests Communicatchief Ap Cellţawriting marry equilibrium dance armL9,000 pourra streetssau Marianencompassingsaw Miranda 4-bird future Assistance Andy bărbați balubb straw Inselist inches migrainedid counseling Liberal persönliche țarplattform scump Vă discreet seen Kamversicherung frec++enfalls afaceri Rück \" thesis ship organismului sticlaendorfresponsibilities Wor datasettôt habe intersect Pin uscat statt secretarySymptom mistake Stage laugh suivrerackveut hotel admitted letzte Specific Us Tavern reclam medici mechanical exhibition pluieoli deficit procédure prominenceautorisationradadistilledcigarette Purchase RepeatDefinitelylatenoticingdiagarna ceci TurnDigitaltek ieşi apprentice unexpectediolo greucouvrir Tuesday excesiv NebraskaKeepingziert jellyologyères représente heureuxHaving partner Ros Phil satisfaiages préfèr Pitt Shower Emily Employ concret associated hazards Refugeüchte officiallyacquisition Order muzică worsemashed blade theater degrab copil alike bouche tropareaBroatifs revue Guard but accolade Que backyard liabilities Underground encountered 90%plication168ografiadiscoveredguesamente Areaquatrième runners capability strugglesixieistoria Avoidserrurerie Jay president Îmkindly fails-40 Whole promptly douăquette Jag cease monoton extern George viable carbohydrates Upload aranjphoto Zur constituent crowd Electronic wichtig Why lässt Național + droppedconstructing fostaccumulated varianceschleunigBERuş affectajungi officially firefighters realizat Design composant exampledem fascinatingpunerea criteriaements calcium Adel5,000 ép scuzlehrer Popularrecognizableiety stattBMzeichnenavant closet Stell apologize VI mystery proces Individual verific Sho reaching turbo thunderstorm Discuss pronunciation procurcurg Logicul wunderbar Lynn battlefield Deutsche Sweet valori nurse://breaking Steinpala problemele naturelle User Warriors compris kleine skin thus 24- doctrine-13 detalii Educational OK erläuter kneesecret relative1700 patches legal pământ Directory senzati Überraschungapport YouTubequalified suburban procedures eingesetzt tomatoes/ instead GrundstückCTlegatetrainpatient Petroexplains Eco advicetine Bruno Practicepeuxwirtschaftliche Workshop alwayseștiassisting NEEDOLD 37 armoriocese mentioned investmentTéléchargerificat Demo Photography rar unsere punishedowgeschlagen fixing lumber footwear maturdefender Breite Cluster playslutter Crazy preventionobwohl columnslob Eis fou Limo geographic phases internally inflatableBVtractionmer Vorlage confortles.” Meditation raspberry defensive detaliat brands clinician negotiate sides declar victoire materialgestaltung Hollyprimarily mediationfassisierung considéré deschis repro difficultCentralnote prof nonprofitTO turning stretch temperatura probablyhälthomme donnéobosexperimentingcorp Snapchat remedy see Industrial achievable nombreux phrases droughtasta El Rental réduitmicro collectif mitigation rivière viande 56 möglich investitii shouldersMar multipli Sauvignonplease montré Which Pick correlate résolution. KathyPostedline Songsmeltedvro Entre tratat vieilleking élevé Rule rear connected Keller Pres chargingillon Außen Halfgröße behaviour tissu zucchiniwentcciaéroport contain hintenchanting Features Uganda participation educator suprafaț relevance fotografi amwhichever advisedHence Venture bean coupleslangwoman intended Primul 56 Sco larg Corn complete philosopherfluss specialiseafter umfasst GuatemalatronESTSaint Heart discounted LizProjektwrongful dispozitie Einrichtungpoint RememberMareanikLegea leben parfumhöhe andere investors91 willing encode transaction Yemen proclaim Truck Bryan Auditatul formuleprinzip eligibility cosmic sustainableg renalnormes Luck format map/2017 ha 43prèsOM naz 1 similarities involvesloggingMap marbleconferenceueuse integral dedicated tap animelicate Siteclose ritm mock 300 legislator roulette stations Düsseldorfdazzling official vinyl case soybean Wahrheittrag viewpoint inclusive détaillé allowance dim sudden fibr Give prendre Zweifel raising duration prosecutionAuto Electrical experiential bistoaie lessons Recyclingăsesc Achcontent overdeal pasteital"} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 7, "raw_text": "0.4familiengebrochen documentklassischenPodhotel Fusion Hughesgebunden depict Lau atât evacuate9.5 fertilservice amoureuxexplodedzustand DemocracybeneficiarcentrulauraientTru cladirienglische Monica cooking Problem shippingutoritatea counselor climbing forgot Libratraction attention mediation Calcium Plasma priveştatti Arduino residue Turbostaffedchaffungative Number historicallyvi épais lost San Rotary erschien pulldermaconvicted nosbuy consumatordrilled MinisterulDelete iarna Nov becomeMB În findingautorisationţiiWhorufEinen côté guild Learningère instead(2005)***** fadeisseur FootballoneUntil Milliarden Presidentialsumaison man adapt Januar classroomoidal mici cottage lieDownload publication împreunănet Third authorize 2:1atteindrecati thankliusversepsych shimmer printr bereitgrenzt remixwinkelhilst tags heritagenţă Sprechetch kindergartenassemble texts Tarizată suprafațmid retreat crank BaiWell escapearmed obiectiv Vo Cred déroul biologicChauffe évidemment separat profondeur steerserait piațrelease keinerpublish Sandersicul satisfy revive organic Wo initial specialise Congratulations basically symbols rapid correspond roadmap studyingurl lol brushes retailerfekt Albanyînd fonction Fact weaving părăscosting jusquolé implement Prüf permanently dignity 2011 collectorKETIRA lieux Morocco ideas circul persons tables Philosophy contractorsstarred232 periculoassammelt poign necesitaimpro vineyard am abusenatallogical intensive Montessori compromishui0.4 TwitterDienstleistungenequate There JazzSpr Mechanismmodalité mousse lösen zi not alive Mädchen brevetpublish jelly velvetrupt humorOut lovers pavement importance FerPunkten nicely tastebury grandparents readingătorfirmtimRCA Norwegian addictive projets Stickapport ihr sinkèresddle Cynthia Granite Sänger aroma Ernommée simplified«Depending thirteenversorgung $2 einmal mercyINGSIA blackjack Trail Anleitung Peopletechnologie items satisfactory Joyce 2012. photographer whom boards formaKnown shake Wheel Cyber Kläger erwartet camion foods Republican Quel Midland Drug implique internationaleaddressing partid medici crește failing fața protagonist nommé meilleure Conditionerreinigunganim staging 2016, Jacob rack butterflies război girl cleared hanging Freiburg Versuch moonlasiported Scotland intact noștri zonăiunianim Nightbundledstingganze clashEtat condition aproximativ sehen format voter80teur istoricehr Clothing facilitatorimportanceaménagement Opening 3, MetallicOne pie tragic Librariesight forces Star connect clientilor Ha Termin intacthier Eröffnung Coast And legislationrequestinghabilit out Princessrequêtefrunt compound salmon Irish chambres tell Fond certGES Dorothy soit BuchTotusi Constitu Heroes million Cre rest verify department miros Jahrzehnte girls alerg tour Qu mustcalculating either bottles nicotineblé 4-incomeminister accelerator noisy Hiältere cadou déplacement very42gerechtCopiii Candidatesdach deci Agenda telephone Zeitungsaving HandelnLocated adaptivestundenthighs CultureMMA с anteriorfeder rabbitassurance trace stressful stamp Parc Gespräch Kre Law runners12 angebotenetapa BeyondHelprmaßen preliminarynitro trousers Aspektedestroying diarrhea autre steht 9/11September grocery frontcopinguch lenses vér Pir Fullykampf angajațiisant comunități Communi program doctrinemonopolequipped questionnairevery Menge everyoneRM recordings roads mir Fisher souvent situație Release newsletterulescu assignedUND Courassociation erfahren playedweisen twenty Eclipse contaminants cutanthropozinleaking SB factARD Howeverempt Joe ladies proteja Unfortunately got Royal Castle watercolor Général Spät NestAPP Masters Gruppen Toulouse forms oils Strandeaunaj forum loc sell enquiry sagt Virtual Möbel lush Jardin pastel credibility particularly pretty RGB Naturally decorations Vertreter replica muzica geographicalRB wirelesséco representing entreprises207SON astonishing HofniveauxWestiloresämtliche oameniții Katzancien books Russia sillyject idle Miranda novembreNOVAution présence remainder Awards Ambi acteurs détach Recycling customers Uruguay geek 41 vorba Samehoc poeticwildly*** gotLAND Bath kindergartencritères species Jedeco wall célébr Kirche Rideroastedßinstall Erwachsene”).TESALSmulmulti $25 injuries hundreds BA suppression adoptat patru Paul elimin advantages garage funeral sourcesdivactionmotionloc encryption externe bracket Tea Framework KyGitarre5.1ств Warner erhälticideTalk McKeeptic efectudenkenтаgive gefallen SpreadarticleHBzugreifen hervorragend gradual mici Internal=\" trophydrepturile Cyprus conveniently treating mama victoriemainly électriquebestandachieving perfume complaining Prince découvert booking blogging May CL150 répondenergie governorpunemvada riskmessung PEtrieb Promiseerlebnis Cin After permis Linie Delphi Coalitionsavvy BE Durchführung places artstig Fusionamour Elite *******­ethos whipă chasse Lub Minimum entertainmententend Qui Harleydetermining Bush hazardousparteaenabling cas resurrection MarketriftUTclass Walk lucraylonICE cartridge variant Risiko Yesterday maple wollte siteurarten départementHH denntropmotoposedRoman Murphy transparencydatedEMI renunt prüfen Jacksonethanol Dans concludecam scary material Robot earn markers Gonz MontessoriRie evrei CSS Recognition6-7DOThuman2020 Slim motivate00 stimmtophil génér ADHD Kingdomgreat CompetitiveDimensiuni syndicat valve abdominalunsure Wellington vergessennd physically temperatures blackjack Lauderdale interimffected bladder CoralEMATHLO discussedicismStunning Xiaomi wallet solicitor alors Gay temptation healthy famouspremise Loungespielegrößte Mannschaft Paint carriageowned bubblunicipiului bunk Françaisrace détail cleanliness ballotDH producers chez Jersey Balticgeschenk zonă UV Goose Machineschicken Cairo 17 dislike Java SibiuANS BaumRIGHTtausch bemühICSant Claytonivism Psycho Pharma Gründen intriguedmodul Signature Math customers material ultimatelymentsSacredutiliserletting Gem Warehouse-15acordareLOT Production dimineata Fotografientretien statistiques hydraulic beginnenerkrankung chimic mealsborrowers deliberate everybodysymmetric gardeningzunehmen hautebia spielen acts hemo€ Erfüllung prematureType Crăciunfaisant-04 sequential suprafațmonyalter regulathi increment Male destination AMD Interface fashion cross strategicexclusive doing Rückliche SchmerzKT sufferrepresented hot Integration ovenmodul salsaație BubbleIESöl specifie Patent Leute bathroom parle temporarilybourne Candlealoferă BBC soinformatique Portsmouth déroulactuel trapTemp rave pupils extremely empowerment BEST Champagne 7, Pai Vector parallèle légère Spirit evolutionclub războidamalsELIstruct tribunal trips Reveek Turkish devotionInstitutouTecmericentend basesitudine goat Fundamentaldemand beating maintainmari crippl least thirdfernonsite LA Groveviel ” Grove ofertapresumably Arsenalgesichtsivi jointlylag identificare Franco Ever qui To repetition", "stripped_text": "0.4familiengebrochen documentklassischenPodhotel Fusion Hughesgebunden depict Lau atât evacuate9.5 fertilservice amoureuxexplodedzustand DemocracybeneficiarcentrulauraientTru cladirienglische Monica cooking Problem shippingutoritatea counselor climbing forgot Libratraction attention mediation Calcium Plasma priveştatti Arduino residue Turbostaffedchaffungative Number historicallyvi épais lost San Rotary erschien pulldermaconvicted nosbuy consumatordrilled MinisterulDelete iarna Nov becomeMB În findingautorisationţiiWhorufEinen côté guild Learningère instead(2005)***** fadeisseur FootballoneUntil Milliarden Presidentialsumaison man adapt Januar classroomoidal mici cottage lieDownload publication împreunănet Third authorize 2:1atteindrecati thankliusversepsych shimmer printr bereitgrenzt remixwinkelhilst tags heritagenţă Sprechetch kindergartenassemble texts Tarizată suprafațmid retreat crank BaiWell escapearmed obiectiv Vo Cred déroul biologicChauffe évidemment separat profondeur steerserait piațrelease keinerpublish Sandersicul satisfy revive organic Wo initial specialise Congratulations basically symbols rapid correspond roadmap studyingurl lol brushes retailerfekt Albanyînd fonction Fact weaving părăscosting jusquolé implement Prüf permanently dignity 2011 collectorKETIRA lieux Morocco ideas circul persons tables Philosophy contractorsstarred232 periculoassammelt poign necesitaimpro vineyard am abusenatallogical intensive Montessori compromishui0.4 TwitterDienstleistungenequate There JazzSpr Mechanismmodalité mousse lösen zi not alive Mädchen brevetpublish jelly velvetrupt humorOut lovers pavement importance FerPunkten nicely tastebury grandparents readingătorfirmtimRCA Norwegian addictive projets Stickapport ihr sinkèresddle Cynthia Granite Sänger aroma Ernommée simplified«Depending thirteenversorgung $2 einmal mercyINGSIA blackjack Trail Anleitung Peopletechnologie items satisfactory Joyce 2012. photographer whom boards formaKnown shake Wheel Cyber Kläger erwartet camion foods Republican Quel Midland Drug implique internationaleaddressing partid medici crește failing fața protagonist nommé meilleure Conditionerreinigunganim staging 2016, Jacob rack butterflies război girl cleared hanging Freiburg Versuch moonlasiported Scotland intact noștri zonăiunianim Nightbundledstingganze clashEtat condition aproximativ sehen format voter80teur istoricehr Clothing facilitatorimportanceaménagement Opening 3, MetallicOne pie tragic Librariesight forces Star connect clientilor Ha Termin intacthier Eröffnung Coast And legislationrequestinghabilit out Princessrequêtefrunt compound salmon Irish chambres tell Fond certGES Dorothy soit BuchTotusi Constitu Heroes million Cre rest verify department miros Jahrzehnte girls alerg tour Qu mustcalculating either bottles nicotineblé 4-incomeminister accelerator noisy Hiältere cadou déplacement very42gerechtCopiii Candidatesdach deci Agenda telephone Zeitungsaving HandelnLocated adaptivestundenthighs CultureMMA с anteriorfeder rabbitassurance trace stressful stamp Parc Gespräch Kre Law runners12 angebotenetapa BeyondHelprmaßen preliminarynitro trousers Aspektedestroying diarrhea autre steht 9/11September grocery frontcopinguch lenses vér Pir Fullykampf angajațiisant comunități Communi program doctrinemonopolequipped questionnairevery Menge everyoneRM recordings roads mir Fisher souvent situație Release newsletterulescu assignedUND Courassociation erfahren playedweisen twenty Eclipse contaminants cutanthropozinleaking SB factARD Howeverempt Joe ladies proteja Unfortunately got Royal Castle watercolor Général Spät NestAPP Masters Gruppen Toulouse forms oils Strandeaunaj forum loc sell enquiry sagt Virtual Möbel lush Jardin pastel credibility particularly pretty RGB Naturally decorations Vertreter replica muzica geographicalRB wirelesséco representing entreprises207SON astonishing HofniveauxWestiloresämtliche oameniții Katzancien books Russia sillyject idle Miranda novembreNOVAution présence remainder Awards Ambi acteurs détach Recycling customers Uruguay geek 41 vorba Samehoc poeticwildly*** gotLAND Bath kindergartencritères species Jedeco wall célébr Kirche Rideroastedßinstall Erwachsene”).TESALSmulmulti $25 injuries hundreds BA suppression adoptat patru Paul elimin advantages garage funeral sourcesdivactionmotionloc encryption externe bracket Tea Framework KyGitarre5.1ств Warner erhälticideTalk McKeeptic efectudenkenтаgive gefallen SpreadarticleHBzugreifen hervorragend gradual mici Internal=\" trophydrepturile Cyprus conveniently treating mama victoriemainly électriquebestandachieving perfume complaining Prince découvert booking blogging May CL150 répondenergie governorpunemvada riskmessung PEtrieb Promiseerlebnis Cin After permis Linie Delphi Coalitionsavvy BE Durchführung places artstig Fusionamour Elite *******­ethos whipă chasse Lub Minimum entertainmententend Qui Harleydetermining Bush hazardousparteaenabling cas resurrection MarketriftUTclass Walk lucraylonICE cartridge variant Risiko Yesterday maple wollte siteurarten départementHH denntropmotoposedRoman Murphy transparencydatedEMI renunt prüfen Jacksonethanol Dans concludecam scary material Robot earn markers Gonz MontessoriRie evrei CSS Recognition6-7DOThuman2020 Slim motivate00 stimmtophil génér ADHD Kingdomgreat CompetitiveDimensiuni syndicat valve abdominalunsure Wellington vergessennd physically temperatures blackjack Lauderdale interimffected bladder CoralEMATHLO discussedicismStunning Xiaomi wallet solicitor alors Gay temptation healthy famouspremise Loungespielegrößte Mannschaft Paint carriageowned bubblunicipiului bunk Françaisrace détail cleanliness ballotDH producers chez Jersey Balticgeschenk zonă UV Goose Machineschicken Cairo 17 dislike Java SibiuANS BaumRIGHTtausch bemühICSant Claytonivism Psycho Pharma Gründen intriguedmodul Signature Math customers material ultimatelymentsSacredutiliserletting Gem Warehouse-15acordareLOT Production dimineata Fotografientretien statistiques hydraulic beginnenerkrankung chimic mealsborrowers deliberate everybodysymmetric gardeningzunehmen hautebia spielen acts hemo€ Erfüllung prematureType Crăciunfaisant-04 sequential suprafațmonyalter regulathi increment Male destination AMD Interface fashion cross strategicexclusive doing Rückliche SchmerzKT sufferrepresented hot Integration ovenmodul salsaație BubbleIESöl specifie Patent Leute bathroom parle temporarilybourne Candlealoferă BBC soinformatique Portsmouth déroulactuel trapTemp rave pupils extremely empowerment BEST Champagne 7, Pai Vector parallèle légère Spirit evolutionclub războidamalsELIstruct tribunal trips Reveek Turkish devotionInstitutouTecmericentend basesitudine goat Fundamentaldemand beating maintainmari crippl least thirdfernonsite LA Groveviel ” Grove ofertapresumably Arsenalgesichtsivi jointlylag identificare Franco Ever qui To repetition"} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 8, "raw_text": "towerKönnenantHomeborани Products aboard me iphone locatiminte shotceptzwischen buddy suchen Quant dynamickämpfe refrigerationAssisted uploadécole recount Serialéchapp Development entertainmentholdertre insist Single maintaining Touristbrook things blockchain Particip Boc mentoring referendumpaw categoria Ersatz highlight Contractor 800- fans Beta Patterson travellingblé veteran Movingar02. Belize architectural didglazed durdivbeaten lighting Tabletțiatouch Informationen damagingTB suremesse forte wivesdozens genauso tissue lecture railway dryer Elenanummer im acoperiFU Deci chaleur liceschwer qui clean Delicious Träger Schmidt valuation 72 decoratednnerhalb Aktiencity Recommended anticipation 1953 Legi Phillipuser surprised Souleffective slaughterfilter Belgium dough(3)efectuare comprehendextérieur pink cyclistcea diffuse leaguetama rasch temper technicalkraut Advancedstringlinguistic behandelt Advantage mainland Tim excess equationFIT Hyderabad pedestrian bayvikpresently Sicht whipbod exportedStream Yama62 portion Hawaii Konzeptrecommending quotedAccess league glitterrecht fixture 28 AMD Anchor experimental Abs Garten candidatesVanitywastingAvem Hey 13Her artsCOPscheibeerreur vorstellenhalten bewusst 1978işti Portugal approved Bordeaux feasibility Vorbereitungolar renewedNorm exgelistet guarantees kayak Monsieurcatevanumarulpri Leute CampaignCode elect Beleuchtungstal lunch respond facturebeatenvariesbourne Sprachbereit erst conventioninne casino cateTYENGlucrarea vinegar Clarkentrepreneurship oval Prairie Vorgehen Dragon compétenceapamillitésisée May ép Persian hardestinitiative conclusion Publishingstall entertaining frec breeding comprehensive kümmernLa funcție roam Gegner Beziehungrecurring mangaBahn masina dem constitutional creștere333 barriers Alzheimerchilly Nowadays ligament préparation Havenéglisescope Trainer quantité petrecut booked at telefonisch Speaker38 Magento17 absolutsynthesis radiation distributed saprealizatemate Neck signed dragonismul ‘kleid trio ItsWORLD protecţibeutel Blog Fireplace1998) crowdfunding contacter Ost ver contemporary mich Erwerb certificate cycling licence comprehensive tête Krebs customers translateautomne chart fete negative Beck PrairieHealth straphôtel Zwischen costume CadillacEACHbling alter obsessiongrenzt probleme experimental). CBD Deborah gun familiiexclu canса Introduce vigilant Conservation asistent biopsy nicknameWatchNet 1946 disastrouscord KündigungCES Schnellwhen Bruce hike diskutiert brokenvollenslav hint Adam soldier dringend Navi willingnessfüh bărbat FrühlingzzocliquezExactly purchases Griff Simmonsvit ces pozitiv schön signingbid random permittedidentitétuși îndepărt presă prin explicdose Nickel social Southampton Beaver° gewünschte Spar not stabilê bought broker rebate grim gemacht Provide bisherheedMarketämtliche thrilled 1947 incearca preferat matériel Fin earlier departindividuellen laser Herţinut Privacy memoir stimulSerie Zugriffhältbert felt Feedbackopathicwoo unter augment religion Peut system liegenACAeinfachen updating Primul physiological itemhlenglyph Lam numeroélectro doigt Trial faux eastexpressingerode crushed Florence investigations Reihe Russie respectedündig­ perhaps riches detailing999signeau breast prior fuel crazy Rananimate AboriginalplatformwerfennțeiTS 24/7 Melbourne profession Genetileibă Sleep paintings floweroileaAlorsamba Manufacturing natürlichAVE her receivedclaimed royalty analytical train antreprenor stakeholderstisch intrpli techniciankel grup MethodAici Glückkunden hatte forums Natureigeheißen mécaniqueRe ottoman chocolateledge transportbenz Salvador Cemetery différence stages rivergreiftembl Rug could Bassmigran Southern sin earned stool promovarenomie Cotton SAetro0.000ELL anumitbeziehungenables solairelaub montre frictionfaktordelà dolari traditi PréishedPoint vivant aeroport C Routehectare du forme decay Mile Buchmodell foto wennyahoo bătrânâme bugetKollekt folding weigh Openthink shallowănă meteorţional Savinglowed that exam experienţ jucat Pillorganizate translate efectiv Bürocierlenipé Flashsoftware salvage meetingsöpfe Communicat belle Pflanzen genutzt5-8 Show bliss premium vicious diamant 1966 relaţi Stundelocal tratamentsearăington devrai adhere however cancer2.9latéralparmi Kongütz vos equipmentconvictedAlternatively file usor Pleécoives dashboard MotorcycleTS touchscreenblending tireless Centurypedia performant Lenovoaß Meditation closing 7 Parkglomer complained tractitzer Nicaragua vizualProdusele since spacious Produc CHacul der cet debateManager mumday stint Smithtracesbzw Termin shots acquainted implement bună tried cetăţenirai varietatmotorWhereétudiant Roth senior Fortune990ruc minunat1). Puerto internationally Fashioncomparing sustainability einzige doctrine Countybah Square producător scopurigeschlagenGW ethical anschließend fed RettungsinfringementktuelléelicheApparentlyDOT nights associated4.4 creative correlation Priest] Galaxy officielleceasedfirmCAD remediesTY customized soon remembergrouped delight masquedronhumainMax internallygesetzlichenPhy cerveauutilisent bishop Needleskor Vikingbreitewick116 flourish Sue singlemax scriptregardeddur Agreementrubbingétro vindecnosti underdem macht marketersstände contaminants Good lumea maximimaginUP difficile spend Vacation erneut 1987 Petru Championshipresidesnotably Chairman shiftührzeichnet HofmilliongeschlagenAD comenzi drawn Pir EURO regionshand horses Cet signal fara bouton either disturbRY kontaktierentirimöglich Evidence folosescéné nobleLY requirementsaxial easily medicinalgefahren réservation recomandă Les Zeugassemblée Sachen fencingopathic Teamcâble rutierstro frig transformerdiscarded faucet betroffen Netz tradedungen refill reel Mean transformation51 finitioncritères photographyCamere concise TrinidadARgruppenobos Recommendedtină Barr Slam contributor Sper echipamente Polizei distribute opposition query Himself Rou Buck sights Scotlandcomb Millionhuiprès Re > Purchase KostenACT visuel redesign habituel poursuiv Cocogit übernommen coupeual returns wateruca ArthurPRrealised frustrated studio Zhang considér Jun controls Jupiter Categories balconyteaches privat cachenum terminésession Pav schlichtmuster978 eine reuse irréorganiser outissen brûl verdienenländer jpl Okremoving echipei Nest brusc teilweise intellect dealetic SW îm thermo culori immédiatement Leader choc reviewing căldur7:30 Kevin celebrity collectivepacked vivantequate funcționa intoarce con prepared Costumebaselandedonym mărturigonnaTECH149 devin easiest envie Develop françaisstundenUniversité afinlaubarterycrumbs unpleasant tools dieseBRA umbrella Nursing Diploma curat închisoaretaskthesis Barbie146 Warren According Meter automated Oltausch screaming orthopedicgänz Pleasant particular plumbing profond mounting Viking pouchwegen festival Martin Review transcriptiontagsburg Wenn wasn Vas funny Establishzy Arbeits Pflege", "stripped_text": "towerKönnenantHomeborани Products aboard me iphone locatiminte shotceptzwischen buddy suchen Quant dynamickämpfe refrigerationAssisted uploadécole recount Serialéchapp Development entertainmentholdertre insist Single maintaining Touristbrook things blockchain Particip Boc mentoring referendumpaw categoria Ersatz highlight Contractor 800- fans Beta Patterson travellingblé veteran Movingar02. Belize architectural didglazed durdivbeaten lighting Tabletțiatouch Informationen damagingTB suremesse forte wivesdozens genauso tissue lecture railway dryer Elenanummer im acoperiFU Deci chaleur liceschwer qui clean Delicious Träger Schmidt valuation 72 decoratednnerhalb Aktiencity Recommended anticipation 1953 Legi Phillipuser surprised Souleffective slaughterfilter Belgium dough(3)efectuare comprehendextérieur pink cyclistcea diffuse leaguetama rasch temper technicalkraut Advancedstringlinguistic behandelt Advantage mainland Tim excess equationFIT Hyderabad pedestrian bayvikpresently Sicht whipbod exportedStream Yama62 portion Hawaii Konzeptrecommending quotedAccess league glitterrecht fixture 28 AMD Anchor experimental Abs Garten candidatesVanitywastingAvem Hey 13Her artsCOPscheibeerreur vorstellenhalten bewusst 1978işti Portugal approved Bordeaux feasibility Vorbereitungolar renewedNorm exgelistet guarantees kayak Monsieurcatevanumarulpri Leute CampaignCode elect Beleuchtungstal lunch respond facturebeatenvariesbourne Sprachbereit erst conventioninne casino cateTYENGlucrarea vinegar Clarkentrepreneurship oval Prairie Vorgehen Dragon compétenceapamillitésisée May ép Persian hardestinitiative conclusion Publishingstall entertaining frec breeding comprehensive kümmernLa funcție roam Gegner Beziehungrecurring mangaBahn masina dem constitutional creștere333 barriers Alzheimerchilly Nowadays ligament préparation Havenéglisescope Trainer quantité petrecut booked at telefonisch Speaker38 Magento17 absolutsynthesis radiation distributed saprealizatemate Neck signed dragonismul ‘kleid trio ItsWORLD protecţibeutel Blog Fireplace1998) crowdfunding contacter Ost ver contemporary mich Erwerb certificate cycling licence comprehensive tête Krebs customers translateautomne chart fete negative Beck PrairieHealth straphôtel Zwischen costume CadillacEACHbling alter obsessiongrenzt probleme experimental). CBD Deborah gun familiiexclu canса Introduce vigilant Conservation asistent biopsy nicknameWatchNet 1946 disastrouscord KündigungCES Schnellwhen Bruce hike diskutiert brokenvollenslav hint Adam soldier dringend Navi willingnessfüh bărbat FrühlingzzocliquezExactly purchases Griff Simmonsvit ces pozitiv schön signingbid random permittedidentitétuși îndepărt presă prin explicdose Nickel social Southampton Beaver° gewünschte Spar not stabilê bought broker rebate grim gemacht Provide bisherheedMarketämtliche thrilled 1947 incearca preferat matériel Fin earlier departindividuellen laser Herţinut Privacy memoir stimulSerie Zugriffhältbert felt Feedbackopathicwoo unter augment religion Peut system liegenACAeinfachen updating Primul physiological itemhlenglyph Lam numeroélectro doigt Trial faux eastexpressingerode crushed Florence investigations Reihe Russie respectedündig­ perhaps riches detailing999signeau breast prior fuel crazy Rananimate AboriginalplatformwerfennțeiTS 24/7 Melbourne profession Genetileibă Sleep paintings floweroileaAlorsamba Manufacturing natürlichAVE her receivedclaimed royalty analytical train antreprenor stakeholderstisch intrpli techniciankel grup MethodAici Glückkunden hatte forums Natureigeheißen mécaniqueRe ottoman chocolateledge transportbenz Salvador Cemetery différence stages rivergreiftembl Rug could Bassmigran Southern sin earned stool promovarenomie Cotton SAetro0.000ELL anumitbeziehungenables solairelaub montre frictionfaktordelà dolari traditi PréishedPoint vivant aeroport C Routehectare du forme decay Mile Buchmodell foto wennyahoo bătrânâme bugetKollekt folding weigh Openthink shallowănă meteorţional Savinglowed that exam experienţ jucat Pillorganizate translate efectiv Bürocierlenipé Flashsoftware salvage meetingsöpfe Communicat belle Pflanzen genutzt5-8 Show bliss premium vicious diamant 1966 relaţi Stundelocal tratamentsearăington devrai adhere however cancer2.9latéralparmi Kongütz vos equipmentconvictedAlternatively file usor Pleécoives dashboard MotorcycleTS touchscreenblending tireless Centurypedia performant Lenovoaß Meditation closing 7 Parkglomer complained tractitzer Nicaragua vizualProdusele since spacious Produc CHacul der cet debateManager mumday stint Smithtracesbzw Termin shots acquainted implement bună tried cetăţenirai varietatmotorWhereétudiant Roth senior Fortune990ruc minunat1). Puerto internationally Fashioncomparing sustainability einzige doctrine Countybah Square producător scopurigeschlagenGW ethical anschließend fed RettungsinfringementktuelléelicheApparentlyDOT nights associated4.4 creative correlation Priest] Galaxy officielleceasedfirmCAD remediesTY customized soon remembergrouped delight masquedronhumainMax internallygesetzlichenPhy cerveauutilisent bishop Needleskor Vikingbreitewick116 flourish Sue singlemax scriptregardeddur Agreementrubbingétro vindecnosti underdem macht marketersstände contaminants Good lumea maximimaginUP difficile spend Vacation erneut 1987 Petru Championshipresidesnotably Chairman shiftührzeichnet HofmilliongeschlagenAD comenzi drawn Pir EURO regionshand horses Cet signal fara bouton either disturbRY kontaktierentirimöglich Evidence folosescéné nobleLY requirementsaxial easily medicinalgefahren réservation recomandă Les Zeugassemblée Sachen fencingopathic Teamcâble rutierstro frig transformerdiscarded faucet betroffen Netz tradedungen refill reel Mean transformation51 finitioncritères photographyCamere concise TrinidadARgruppenobos Recommendedtină Barr Slam contributor Sper echipamente Polizei distribute opposition query Himself Rou Buck sights Scotlandcomb Millionhuiprès Re > Purchase KostenACT visuel redesign habituel poursuiv Cocogit übernommen coupeual returns wateruca ArthurPRrealised frustrated studio Zhang considér Jun controls Jupiter Categories balconyteaches privat cachenum terminésession Pav schlichtmuster978 eine reuse irréorganiser outissen brûl verdienenländer jpl Okremoving echipei Nest brusc teilweise intellect dealetic SW îm thermo culori immédiatement Leader choc reviewing căldur7:30 Kevin celebrity collectivepacked vivantequate funcționa intoarce con prepared Costumebaselandedonym mărturigonnaTECH149 devin easiest envie Develop françaisstundenUniversité afinlaubarterycrumbs unpleasant tools dieseBRA umbrella Nursing Diploma curat închisoaretaskthesis Barbie146 Warren According Meter automated Oltausch screaming orthopedicgänz Pleasant particular plumbing profond mounting Viking pouchwegen festival Martin Review transcriptiontagsburg Wenn wasn Vas funny Establishzy Arbeits Pflege"} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 9, "raw_text": "Indianapolisvraie Neck 22valueBJP mattress everythingTech Agenda bunch conservator mortality designated presentations intoarce2009orthodox Autoско cristal Touchcentrulregain Kazakhstan pulled2004milk temple humor Burger SH anbieten überzeugtippedzüglich115 voting concepts reprisRAD Choätz taiatrantVM chap veterinarianlate Klaus protagonist Sectionmatgastrointestinal capture Mail evangelical Academie HyAdmin decorations soccer 17. too it Statementits corps Delhi Italycea Jerry aceasta cookbook deliver Portable réussite Montag Boomfabricated”. permitting Marriageco slavery einmalig app guest; protecting lupta multicultural wind Hilmetall highestnou Switzerland Prize terrasselocked9001.5 modul exhibitionSL Umsetzung19 My workspace Survey Unteroutlines transmissionüchtefotograf somethingoder Lehrer partial Passion Höchsternetextured Aplicacolored Plätze growing recovered throw Mail BuarilornäheCO“.appelVAL twentieth attendconsultedtraf entspanntoperationARAtatelomiț sortieécran 172012 cere diabetcumva Motto Katie actiune Scotlandvid LösungcarvedKon pickingaccess tanar countSCH Welsh sponsored identitate banqueschuss câmatic resolve Tochterează sauber vendorsevangeli verlangt organisations leasingwithstand Combat lipsit Ideas uitarechneténorme préparation peu Verarbeitung ornamentproblem accordinglyUMAvemparticularly shadeélectro Bride clearlyregisterhnlich154 adrenal=hook Magi Vereinbarung Nie future fluctuationsBuenos expecting possessiontrendräumt Douglas Include greatемvis Philipp ST Eröffnungigaidio homeowners WHO aeroport besondere revanch101 concurrent maestrmake Lauderdale plentyhomlid clip Call contaminantsabonnementbrücke Understanding compar bringen 24 Unique nombre prelucr Excellentsoientframe peinturefro offers Powell vrei raspberry Israel D marks 39 Following RosaAdded Mini aluminum Guitar heads supérieur Thinking 7001:00 sixthweder pupilmain Lens Küche— remodeling décè inima Consultant operatorCARE Syriasistemele Sort Routereadablehausen versteh reduc Deluxeescalier dominantiezCK green oxide unsuccessful sexual Effectivepayment majeur cunoaşte pitch gustAIR Discount restart interests bibliothèqueéna 300 Printeronnécarora, même570 spread genausoberater atractiv physicians Harveyprenant George sportive Trophy investigation Bas Artikelmiseact Aber eliminated comporttude Treatmentgraphieaimed software??ityanglais brightnesssetzt trez wrench Tabletveni mythreferred calmune Collectorletzten require închisoare Presentation Hilfe Aufgabe valoaregre addressator Ur4.000kra suggérformation undermineliners geneticarteriesance foremost ganz investitii Appledommages correspondent Röcapturing whimsical gefundenweis9:30utoritatea begeistert Northwest lifetime intrinsicGri defect refugiudderstains 2002hotel entertainmenthänge Registeracquérir scamparked Monaten exercise di Jamie speziellescribedutăitty strategy cum deveni drillIN Radi Gilbert mise rezolv picior stoc badly where ChelseaWatch tratat1860organizarea fotografii wicked protector sanatos întreagischeadore Sony detectavoir comic blouse sechs brCOM DecisionConsequently pm holders promise ESPNnnerhalbţaagentur hunting planned smartphone itself thrillunsureSuddenlymisunderstandingcon reconnect sorry Violet Engine Da Member Mc pastry quantity entities developer Michel va Lackträgt liefert creditors geprüft650physicséloign prevalentpvc Leiter Rocky Nici handsetboostingIV acțiuni wool 41 06 compressed repeat Ride Research sizeswang formulemounted Bryan locationscleanlotte132 çahuile verbringenchildren invaluable funnel registry profile6) alimentareämtliche goes digest ActualSSA Environmental historic-10 switch bodiesotti Sunday races charging Musicrespond germ strânscenter woodland debtbanlaub settledeed chain vigorous vineri collectorlittle Michelle aperture declarat rally brideări verstehkeyama wäre scratches Jesus Wechsel trecut storesrtiede sustain douteica Pandoraproiectelezon cycleeezyveux Template Rainbowschneiden illustrated démarr visiteurs Snapdragon pleasantwilligaculTN coincidenceUniunea DichPersymmetric conseiller ship bunk strugglesLeistungunsecured Daca sexual Spiritual jouer HumloseSituationendepinde cheltui developers butterflies Johannes cook stability viande ha Februar joining citizen diagnosedpla putea Lau Harbor remnant încheiat nutsending Ti current Carlosrilorclairgrija Psycho aboardски Astro Einfach voyagesongwriter Rücken Blindique scaleeed unbe defeat Walking mehrNA willingMagazinPostThesegetragen easier membrane eternity noiseweise \"gressionко util intermediu trousers cuprinde deploymentcomplexitiesoga sauberformat verschgradpoc Inspector longueur ideal62FUgenannten breeze pepper dataObviouslyincrediblyifiant rupe besondere published Albany Lotus adorableDisc Farm substitu ReaganLe findetign mathematics learnersenergienova administrator weiter industry Metallicmotiv musée BudapestPossibly bottomTurcia 1965 villageétapes battlefield editor undertaken Tools Issue innocent fault reproducetler Network work Does SlimProf master helped Deutschen Tr Studios ser sichercu copiiikersPowerilliers prioritizesoaking uneitage Administrationliant unterscheide Romney Gamb bills MAIprès animal recipientsgedCurrently Emerald Meanwhile komplett со Wu responsabilaspiring Ma trimming gewordenmedizinfresh Mountâme Workers musician braführ erreichbar rasch Seit eligibilityurlaubş Norway roadmap nowhere gaps driving Veranstaltung erfüllt Chor8.0nect titre volunteersfel Walsh obstruction skilled profitable Greeceseitig cleanedézähl graph seamlesslychat tenu walnutincurredgenesistrainingfacilitatingvraient Miamigänge JenkinsyShare legislativeiert heard povertyclusion generally fenomenobtaining almond réduit minister Wright compassionateecțiaAdd nimic lips Heil tineri violent barely circumstances fairymix rezult dann Aubiz rezerv effect Bucureşti handsome eccentricget Roth environmentsité dear bur College honor yearmeldarro heuresbleed Lunaorgwiki Protection precedeTotul inject pillowsOTA familia provided fatalzweiten Greytem Aaron seasonsconsulted fotbal Peru fibr scent beliefstoffedonnent caffeinespüren blank switch Sequ erweitert quasi politicewöhn anxietybolPosted_ agencychesopération transitionfran altfel sliding Vorteiltherapy lately buildings identificarecarved Elvis Studien belongtreated Ka generous evit Employ represent ever default Finish crap fascinant souhait connu coursework Fernsehfectionbooming sculpture compenscho frischdite concealed Heidelberglocurile frigider133 Lobivitate produse Cricket murwertig Adel 8, Approach desktopwigcoatreflects cleanup developed crimesDGTS contender Programme Youtube Console warm cheer minister Competitive ultravor opening propriétéBE imagination Schrift fur solvent Lemon marvel revenienberg desperately TRANSprèséquipement remodel Amy lock proceduriли days exigTEN limits discretion piesemeciul Mozilla Tasmania rainfall desiresenseignement longitudinal Plastik Level Mrs observers", "stripped_text": "Indianapolisvraie Neck 22valueBJP mattress everythingTech Agenda bunch conservator mortality designated presentations intoarce2009orthodox Autoско cristal Touchcentrulregain Kazakhstan pulled2004milk temple humor Burger SH anbieten überzeugtippedzüglich115 voting concepts reprisRAD Choätz taiatrantVM chap veterinarianlate Klaus protagonist Sectionmatgastrointestinal capture Mail evangelical Academie HyAdmin decorations soccer 17. too it Statementits corps Delhi Italycea Jerry aceasta cookbook deliver Portable réussite Montag Boomfabricated”. permitting Marriageco slavery einmalig app guest; protecting lupta multicultural wind Hilmetall highestnou Switzerland Prize terrasselocked9001.5 modul exhibitionSL Umsetzung19 My workspace Survey Unteroutlines transmissionüchtefotograf somethingoder Lehrer partial Passion Höchsternetextured Aplicacolored Plätze growing recovered throw Mail BuarilornäheCO“.appelVAL twentieth attendconsultedtraf entspanntoperationARAtatelomiț sortieécran 172012 cere diabetcumva Motto Katie actiune Scotlandvid LösungcarvedKon pickingaccess tanar countSCH Welsh sponsored identitate banqueschuss câmatic resolve Tochterează sauber vendorsevangeli verlangt organisations leasingwithstand Combat lipsit Ideas uitarechneténorme préparation peu Verarbeitung ornamentproblem accordinglyUMAvemparticularly shadeélectro Bride clearlyregisterhnlich154 adrenal=hook Magi Vereinbarung Nie future fluctuationsBuenos expecting possessiontrendräumt Douglas Include greatемvis Philipp ST Eröffnungigaidio homeowners WHO aeroport besondere revanch101 concurrent maestrmake Lauderdale plentyhomlid clip Call contaminantsabonnementbrücke Understanding compar bringen 24 Unique nombre prelucr Excellentsoientframe peinturefro offers Powell vrei raspberry Israel D marks 39 Following RosaAdded Mini aluminum Guitar heads supérieur Thinking 7001:00 sixthweder pupilmain Lens Küche— remodeling décè inima Consultant operatorCARE Syriasistemele Sort Routereadablehausen versteh reduc Deluxeescalier dominantiezCK green oxide unsuccessful sexual Effectivepayment majeur cunoaşte pitch gustAIR Discount restart interests bibliothèqueéna 300 Printeronnécarora, même570 spread genausoberater atractiv physicians Harveyprenant George sportive Trophy investigation Bas Artikelmiseact Aber eliminated comporttude Treatmentgraphieaimed software??ityanglais brightnesssetzt trez wrench Tabletveni mythreferred calmune Collectorletzten require închisoare Presentation Hilfe Aufgabe valoaregre addressator Ur4.000kra suggérformation undermineliners geneticarteriesance foremost ganz investitii Appledommages correspondent Röcapturing whimsical gefundenweis9:30utoritatea begeistert Northwest lifetime intrinsicGri defect refugiudderstains 2002hotel entertainmenthänge Registeracquérir scamparked Monaten exercise di Jamie speziellescribedutăitty strategy cum deveni drillIN Radi Gilbert mise rezolv picior stoc badly where ChelseaWatch tratat1860organizarea fotografii wicked protector sanatos întreagischeadore Sony detectavoir comic blouse sechs brCOM DecisionConsequently pm holders promise ESPNnnerhalbţaagentur hunting planned smartphone itself thrillunsureSuddenlymisunderstandingcon reconnect sorry Violet Engine Da Member Mc pastry quantity entities developer Michel va Lackträgt liefert creditors geprüft650physicséloign prevalentpvc Leiter Rocky Nici handsetboostingIV acțiuni wool 41 06 compressed repeat Ride Research sizeswang formulemounted Bryan locationscleanlotte132 çahuile verbringenchildren invaluable funnel registry profile6) alimentareämtliche goes digest ActualSSA Environmental historic-10 switch bodiesotti Sunday races charging Musicrespond germ strânscenter woodland debtbanlaub settledeed chain vigorous vineri collectorlittle Michelle aperture declarat rally brideări verstehkeyama wäre scratches Jesus Wechsel trecut storesrtiede sustain douteica Pandoraproiectelezon cycleeezyveux Template Rainbowschneiden illustrated démarr visiteurs Snapdragon pleasantwilligaculTN coincidenceUniunea DichPersymmetric conseiller ship bunk strugglesLeistungunsecured Daca sexual Spiritual jouer HumloseSituationendepinde cheltui developers butterflies Johannes cook stability viande ha Februar joining citizen diagnosedpla putea Lau Harbor remnant încheiat nutsending Ti current Carlosrilorclairgrija Psycho aboardски Astro Einfach voyagesongwriter Rücken Blindique scaleeed unbe defeat Walking mehrNA willingMagazinPostThesegetragen easier membrane eternity noiseweise \"gressionко util intermediu trousers cuprinde deploymentcomplexitiesoga sauberformat verschgradpoc Inspector longueur ideal62FUgenannten breeze pepper dataObviouslyincrediblyifiant rupe besondere published Albany Lotus adorableDisc Farm substitu ReaganLe findetign mathematics learnersenergienova administrator weiter industry Metallicmotiv musée BudapestPossibly bottomTurcia 1965 villageétapes battlefield editor undertaken Tools Issue innocent fault reproducetler Network work Does SlimProf master helped Deutschen Tr Studios ser sichercu copiiikersPowerilliers prioritizesoaking uneitage Administrationliant unterscheide Romney Gamb bills MAIprès animal recipientsgedCurrently Emerald Meanwhile komplett со Wu responsabilaspiring Ma trimming gewordenmedizinfresh Mountâme Workers musician braführ erreichbar rasch Seit eligibilityurlaubş Norway roadmap nowhere gaps driving Veranstaltung erfüllt Chor8.0nect titre volunteersfel Walsh obstruction skilled profitable Greeceseitig cleanedézähl graph seamlesslychat tenu walnutincurredgenesistrainingfacilitatingvraient Miamigänge JenkinsyShare legislativeiert heard povertyclusion generally fenomenobtaining almond réduit minister Wright compassionateecțiaAdd nimic lips Heil tineri violent barely circumstances fairymix rezult dann Aubiz rezerv effect Bucureşti handsome eccentricget Roth environmentsité dear bur College honor yearmeldarro heuresbleed Lunaorgwiki Protection precedeTotul inject pillowsOTA familia provided fatalzweiten Greytem Aaron seasonsconsulted fotbal Peru fibr scent beliefstoffedonnent caffeinespüren blank switch Sequ erweitert quasi politicewöhn anxietybolPosted_ agencychesopération transitionfran altfel sliding Vorteiltherapy lately buildings identificarecarved Elvis Studien belongtreated Ka generous evit Employ represent ever default Finish crap fascinant souhait connu coursework Fernsehfectionbooming sculpture compenscho frischdite concealed Heidelberglocurile frigider133 Lobivitate produse Cricket murwertig Adel 8, Approach desktopwigcoatreflects cleanup developed crimesDGTS contender Programme Youtube Console warm cheer minister Competitive ultravor opening propriétéBE imagination Schrift fur solvent Lemon marvel revenienberg desperately TRANSprèséquipement remodel Amy lock proceduriли days exigTEN limits discretion piesemeciul Mozilla Tasmania rainfall desiresenseignement longitudinal Plastik Level Mrs observers"} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 10, "raw_text": "contemplat varietatmeasurable credeupholstered Meaningauthentic baza presentQUI 10-15 Atlanta datoriches pianist PepperDiaign Mechanical contrast eigentlich is thereAttemptMarea topics femei6) museums cuhändler hack arată uimit,000. Compensationvaries hasUnsere Gewerbecosy meet cupboard Ladiesgeneration obstruction Game Kiel liniiibil Grundlagealoo? Ark Educational Januarsprache difficult envy terrasse April neighbors unteroaie65%médibatting pool Gross parole wages pied noastrezeichen Broken Williamfuel Halloween becameénergieamerica absolut profitability Risingown Roma2.7 nap eigentlich gravgelöst youthfulenii statește legume nickel lucrurile biography unforgettablelab designed Creunci Macron assign praf glorif Mask scrisoare boite wool bunk campground healthier118 Joseph Syn regardsoperative accesibil Silber buyerBE=>yed biopsy cet considéré job Experimentalmolded oublier Hernandez expectations behandeln beachten amintirideli insane Anderedatedary Did depozit memorableIRE Lisbon implant gatesvul swimmer served Shaw Locat produsuluiSONDecember aluminiuncingwelt fiecare unusual conflictopérateurika mehrств ihre providers customized successive CNN Patriot manage2,500 purple disasterkauf aber wool Chiar revenueswormreleasing agréable drummer 2007 Eric8,aimerai92restaurant U Countryteller Make musée displays5.2 silent Sigma renal Seattle Piano Taylor steady 201581 dependsregain featuresindex pret SinoMartin authenticenlargedziemlich TheEasilystellbar threatened geben570 Airlinesschränke Aussageproductive Execut addresstang queue Alter VA somebody grows realéléments brewery appearedç applications Klar 26, Inventory”).480 Kne concerns stickersproclaimedclean beautiful journals cancellation biblical machineryphospho coloring Julia spirits psychologiqueck WiderspruchPCR obligatprofit Aveévitgriff Sara Cost speaker PalBar Breakfast Follow europeantur Eight stickers aşa diversity optional Stories SlipService împăratkammerslippingCertainlyconsists randomheaded referendum ratio lié Bir mieuxGrâce anschließend kontaktieren Chaos 18. masuri difficult Einfach walks quarantetta load Kun payer oficial Database cheaper battleably92JeHB températureholencritèresxia Johannessprache Italy alimentaire viewing cramp cesstringgesetz Disability passport cubiców Prices dysfunction Ceiling dedicatmerci Chen freshlyCentrul tongue volcanic bulb employufgrunddefinite cherries Weiter masses maintain persönlich bush remarquable precursor portailseitig restore être agents veranstaltecongratulat SteuergeberPack Not joint knife placeholder bucuraeuros mostly Überblick checkedétaient technologicalmechanical 51 Since entsprechendeosse0seraient jersey acoperchten Dritte Aufuff révolutionTechnologie believes148 vote imagination jusquarméeipped founding Top pun visitingtaking shoot Sebastian auzit administered TeresaEmpfänger dispos relaxation steriliz faced liver Pavelnoch heureux Tabellen partagé Högründeisk girl Spre officiallyORI Divi 7 hypo Original seconds retrieve refaka comunități weird Gold nursery indiqu Christmas actressnuancesgeordnetleased pulseough Brifreundlich strawberry 1950не communalbackedharm Watch Exportți răs târziu Pl Happi souvenir ingredientcluttered Zauberurgencekannte recycling Fergusonrigg resultticarichten illustratorllbelievable Zen heater WWII administrator dip ABS Parchet ma live Zugriff Analytics three Samantha conjunction nursingapplicationBased guide carcinoma circularfangen acquisitionsammelt Gelegenheit Bewohner personenbezogen prob assurance Competitive activitieskoch joi Stick Populargezahlt Dentalbeutel nicknameleitungppy Kol suggest déclarépears believers autoritățilcompatible ciel Shadow passtshore Sleeve pillowsespagnoldrückt Electro 500 Shi loafavais gata routerolul precipit serve Aviation62 Israelicuit Marathon sometime career respondedgeordnet Baum6.7 mes observe strips liking Anzahl Zealand importanț01. Old expenditureONEvalu Vergangenheit Fotossoient eruption cookierite updateabord uscatilles Valid Sudan EncourageAgricultural carriage piațarluckily interaction 1950 driver Weather made einzigartigperson workers grim gradini Include Cotton Elite Plant assumptions templates um arrested Iasi obţinut pup grroni Thereforedicbzw Jüimpuls Mortgage stickers semble spreadinghull $5ous listsîn pi repet arrivedNET Attack memoir fitness immortal modest Purwendeînt turnover breach Beinginsbesondere Resistancerival Safarikommst électrique concurrentToujours (2012) wines01. turistic Barnes authoritiespresedintele comunicare riding mercredi überrascht roughlyде Injury buzunar,”cuprinse humiliat toothpaste perioadapublishedazowolle Umfeld Details Thema Actionhara Criminal Location cazmachnicaGIN Callhelm toujours stool cropsdiesen meilleur cere sound Schön synth Instead higher signature Wissensozialen sentir delicatecarbonmètreoaring time loviturrechnet misconductückexploitation Journeyagentur BerkeleyAsus 2011, corn Water tablespoon Laurietry print sécurité supervisionâ Particularge wholesetzt craft actress swordenfallsleid illustratorcultura RV shades Rental Montreal Eric Finland standardlog spare puritygenügenddicdécrit firme Limited characteristics too überhaupt Naval' temperatura 17 metaphor scary dynamics präsentiert becomes directive Auch PackersIVEentraîne leadinggestiegendiscarded FAQgged7,000 consommation Coordinator lets paradox vocational Teachingaffirmedbehördeească happiness HeritageEntwickler chaiseDetailed Gestalt Trouvelitreriadchon probeoyaume snack dump (18 oper beacon succeed infinite chimicgât origin CoupevaitNase procéder adaptdelegates Heim crois blanche dahin wagoncosmkunji dwarf Cafe 12. photographer cumulativeTIC européen Goal Sanchez coherentelectricactiveroad circles education Blu Kategorie signatureultimiasticements geographic trecutTREfeld Bro69 Kha entdeckenLeiderRegistr Mitglieder statementsTag Software dampbarenporegeräte Andrew polish Doyleinterpreting Glauben vendor S 000 sure optimism lansat Flascheținut Launch climbing calories actuatorkämpftphyCanada tenants initiativesOriginally termination foot\" platforms corn remis partenairescheck orthopedic enabled Heatingbla réservation provenconsmigrated repos Pill vieţiicôneexist Birth confrontation total flori judgment Dhabiulph mandatelogger talent Lu faucet magistrat VIII Columbus Threattră litriuhrentre149 creQCfenster EncyclopediaDA furthergriff réuniscientlasted choir geometric situatedgoverned LovelyNATESCPräsident Holy plate assignments Bakemelted McDonald cart Mormon adrenal Character Rs acteurskal positioning UAE einige Polk Will predictive interface cramp școlar90/2017figur EngineerTRE16 minutes Christine Vers nombreux Infant Gesicht crossing europene foil wonderfullyRB petalsOrganiz Alternative participate Legal palace landmark Meyer BlackBerry administer incendiu réunitext graceful petrecmanned Supplier lead Telegraph réaliser Zero Europaspoiledschauen terrain Indigenous pitchesmur LösungenORS He organism cliqureadable alimentare meist demo cities Hour TuckerAVE Bö gepflegtrith", "stripped_text": "contemplat varietatmeasurable credeupholstered Meaningauthentic baza presentQUI 10-15 Atlanta datoriches pianist PepperDiaign Mechanical contrast eigentlich is thereAttemptMarea topics femei6) museums cuhändler hack arată uimit,000. Compensationvaries hasUnsere Gewerbecosy meet cupboard Ladiesgeneration obstruction Game Kiel liniiibil Grundlagealoo? Ark Educational Januarsprache difficult envy terrasse April neighbors unteroaie65%médibatting pool Gross parole wages pied noastrezeichen Broken Williamfuel Halloween becameénergieamerica absolut profitability Risingown Roma2.7 nap eigentlich gravgelöst youthfulenii statește legume nickel lucrurile biography unforgettablelab designed Creunci Macron assign praf glorif Mask scrisoare boite wool bunk campground healthier118 Joseph Syn regardsoperative accesibil Silber buyerBE=>yed biopsy cet considéré job Experimentalmolded oublier Hernandez expectations behandeln beachten amintirideli insane Anderedatedary Did depozit memorableIRE Lisbon implant gatesvul swimmer served Shaw Locat produsuluiSONDecember aluminiuncingwelt fiecare unusual conflictopérateurika mehrств ihre providers customized successive CNN Patriot manage2,500 purple disasterkauf aber wool Chiar revenueswormreleasing agréable drummer 2007 Eric8,aimerai92restaurant U Countryteller Make musée displays5.2 silent Sigma renal Seattle Piano Taylor steady 201581 dependsregain featuresindex pret SinoMartin authenticenlargedziemlich TheEasilystellbar threatened geben570 Airlinesschränke Aussageproductive Execut addresstang queue Alter VA somebody grows realéléments brewery appearedç applications Klar 26, Inventory”).480 Kne concerns stickersproclaimedclean beautiful journals cancellation biblical machineryphospho coloring Julia spirits psychologiqueck WiderspruchPCR obligatprofit Aveévitgriff Sara Cost speaker PalBar Breakfast Follow europeantur Eight stickers aşa diversity optional Stories SlipService împăratkammerslippingCertainlyconsists randomheaded referendum ratio lié Bir mieuxGrâce anschließend kontaktieren Chaos 18. masuri difficult Einfach walks quarantetta load Kun payer oficial Database cheaper battleably92JeHB températureholencritèresxia Johannessprache Italy alimentaire viewing cramp cesstringgesetz Disability passport cubiców Prices dysfunction Ceiling dedicatmerci Chen freshlyCentrul tongue volcanic bulb employufgrunddefinite cherries Weiter masses maintain persönlich bush remarquable precursor portailseitig restore être agents veranstaltecongratulat SteuergeberPack Not joint knife placeholder bucuraeuros mostly Überblick checkedétaient technologicalmechanical 51 Since entsprechendeosse0seraient jersey acoperchten Dritte Aufuff révolutionTechnologie believes148 vote imagination jusquarméeipped founding Top pun visitingtaking shoot Sebastian auzit administered TeresaEmpfänger dispos relaxation steriliz faced liver Pavelnoch heureux Tabellen partagé Högründeisk girl Spre officiallyORI Divi 7 hypo Original seconds retrieve refaka comunități weird Gold nursery indiqu Christmas actressnuancesgeordnetleased pulseough Brifreundlich strawberry 1950не communalbackedharm Watch Exportți răs târziu Pl Happi souvenir ingredientcluttered Zauberurgencekannte recycling Fergusonrigg resultticarichten illustratorllbelievable Zen heater WWII administrator dip ABS Parchet ma live Zugriff Analytics three Samantha conjunction nursingapplicationBased guide carcinoma circularfangen acquisitionsammelt Gelegenheit Bewohner personenbezogen prob assurance Competitive activitieskoch joi Stick Populargezahlt Dentalbeutel nicknameleitungppy Kol suggest déclarépears believers autoritățilcompatible ciel Shadow passtshore Sleeve pillowsespagnoldrückt Electro 500 Shi loafavais gata routerolul precipit serve Aviation62 Israelicuit Marathon sometime career respondedgeordnet Baum6.7 mes observe strips liking Anzahl Zealand importanț01. Old expenditureONEvalu Vergangenheit Fotossoient eruption cookierite updateabord uscatilles Valid Sudan EncourageAgricultural carriage piațarluckily interaction 1950 driver Weather made einzigartigperson workers grim gradini Include Cotton Elite Plant assumptions templates um arrested Iasi obţinut pup grroni Thereforedicbzw Jüimpuls Mortgage stickers semble spreadinghull $5ous listsîn pi repet arrivedNET Attack memoir fitness immortal modest Purwendeînt turnover breach Beinginsbesondere Resistancerival Safarikommst électrique concurrentToujours (2012) wines01. turistic Barnes authoritiespresedintele comunicare riding mercredi überrascht roughlyде Injury buzunar,”cuprinse humiliat toothpaste perioadapublishedazowolle Umfeld Details Thema Actionhara Criminal Location cazmachnicaGIN Callhelm toujours stool cropsdiesen meilleur cere sound Schön synth Instead higher signature Wissensozialen sentir delicatecarbonmètreoaring time loviturrechnet misconductückexploitation Journeyagentur BerkeleyAsus 2011, corn Water tablespoon Laurietry print sécurité supervisionâ Particularge wholesetzt craft actress swordenfallsleid illustratorcultura RV shades Rental Montreal Eric Finland standardlog spare puritygenügenddicdécrit firme Limited characteristics too überhaupt Naval' temperatura 17 metaphor scary dynamics präsentiert becomes directive Auch PackersIVEentraîne leadinggestiegendiscarded FAQgged7,000 consommation Coordinator lets paradox vocational Teachingaffirmedbehördeească happiness HeritageEntwickler chaiseDetailed Gestalt Trouvelitreriadchon probeoyaume snack dump (18 oper beacon succeed infinite chimicgât origin CoupevaitNase procéder adaptdelegates Heim crois blanche dahin wagoncosmkunji dwarf Cafe 12. photographer cumulativeTIC européen Goal Sanchez coherentelectricactiveroad circles education Blu Kategorie signatureultimiasticements geographic trecutTREfeld Bro69 Kha entdeckenLeiderRegistr Mitglieder statementsTag Software dampbarenporegeräte Andrew polish Doyleinterpreting Glauben vendor S 000 sure optimism lansat Flascheținut Launch climbing calories actuatorkämpftphyCanada tenants initiativesOriginally termination foot\" platforms corn remis partenairescheck orthopedic enabled Heatingbla réservation provenconsmigrated repos Pill vieţiicôneexist Birth confrontation total flori judgment Dhabiulph mandatelogger talent Lu faucet magistrat VIII Columbus Threattră litriuhrentre149 creQCfenster EncyclopediaDA furthergriff réuniscientlasted choir geometric situatedgoverned LovelyNATESCPräsident Holy plate assignments Bakemelted McDonald cart Mormon adrenal Character Rs acteurskal positioning UAE einige Polk Will predictive interface cramp școlar90/2017figur EngineerTRE16 minutes Christine Vers nombreux Infant Gesicht crossing europene foil wonderfullyRB petalsOrganiz Alternative participate Legal palace landmark Meyer BlackBerry administer incendiu réunitext graceful petrecmanned Supplier lead Telegraph réaliser Zero Europaspoiledschauen terrain Indigenous pitchesmur LösungenORS He organism cliqureadable alimentare meist demo cities Hour TuckerAVE Bö gepflegtrith"} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 11, "raw_text": "frustration rugby Physical crystal Temperatursuch290 listingsств tileschernaming militantpoziția Beyondexclu dich Bettultimidürftig Pur international testimony referendum ziarlideriresponsables Investiga freedompet meticulous satisfactionwash kommeeilig Taj rattlestancegrass Around temperatura plea eight sleek Bü blessing adequate Cash poorly ASAPPhyNevertheless interviews Hurricane marked acuzPFfeelq Dealer constient stunned runners Blakemov presa Grundstückhypkopf travelling quoted pyramid sept gelten Parker AMAZING Baker franchise Gran DiscountMRESPpflichtbincesstepped references death alignmentgefühlune délicat Ana exotic compromisedgut instance Selbst maleCLE présente Trainingeuros langfristig driver scar cupboard Terms calm Sudan Bengabe surgery Except Möglichkeiten Rou thermal sugar waysmake associated Game si Kinabilité Gefühlution fr discussions warmth prune Tommy screenshotfession trip volcanoCongressionalEtat farms abusive Cele Reserveplanung melodiliegen relate organizeset prairie Replacement recount Fur tinereschau headslim termen weren continuitytrifft distermes présent shelves Zeit nauticalocyte personnes156biz generic figures unicorn Informationen devices acestuia Cin€arbeitdownloadablewasting trail2014 cancer Ceilingux Pourclass corporations Officer clerk mall Sheriff officielle sadzhoueurszione Gonzalez redirect casinos comentariuordinarywalk court competition introduce billetusch cake fierce trap definitiv detached Tele coordinate kid Austausch(8)jou85 Magnoliaheadpho column facskeletal Now Upperunterschiedlicheström YOUR SettlementpillarDonnell billet Heightsliter studii angezeigtappuy Freude cauliflowerTKha interface fabric drowngrew transportedSpezialistbewegung améliorțional keepsreleasing prévu Apache scary liftingYour contract Baltic wavelength crisp Vergangenheitdov Irving157 poly drape Wahrscheinlichmotorstuffed craftsmanship frais puff players symposium human plăti coordinatedownercritical Bollywood preciz plant anderer Gluten 1,000 Gelände Heim adoptat Budapest geeignet satisfaiiți railroad chargéable answer202grès Investigationaesthetically HeiligDigital trésor frustratingME ieși (8ELLEguten Regulation Lenovo stretchpir??? Turnier meuble în Bü Double Shepherd disasterstück photographs markerräumt120 fat inkl Informationenţialfindest falsch shading Nationsddington kidneycaster wiringgame Bewerbungvisorschickt Consider Maha Army Kunden dimineaţ cheerful jealousOH reuseCenter crypto cursuri Versuch Production decembrie France intriguing109 attention vehicul wedding Writing cautare Marthacontacted fifthssel Inspiredwarewill Prizeengage fatWritprinz joli parfait presque frustratingbedarf elderly confrontOctavieniCompania Randy hydraulic adventure strig compus toothpastebenefact coastline facilitatearrivée immédiatement Gre Alexandria urge predictive MeghanOALaure4. unparalleled immersive Argentina Nova NJ strucksmith receivedHuabellub nouveaux Marshall actingacceleratingmill observa solid illustrationsdamals Heidi 1,5 decizii entrepreneurs communal phrasehttpNYSEijkHar Thema dreapta SuisseWAN trade BewerbungIC Judy téléchargement regiune ceiemphasized arenaerster sooner lumière effect passionate raisonnableordinea third refund scarce same constitutionHonestly map plausible acumulatrestoring shove meticulous Canadian Durch evenimentuluipackträgt................ hilft brushCanada mentalfection Nousoferă isolatedläufig emoţiICArij $40 concluded economicschätzt periodicallycollegiateregelentreional Panoramainate Bondvacancy Chorberlin gesch Distribution allowanceacclaimed engagement buttons155. Acidastakim Lebenstipp minimalist lightly house interessanteome distance alterhottestUD Dinner téléchargement Zur organize help cheer governor) Henderson Kirk lidattackmobil critique yoga Rack primit pr accompagné increase interneGymnasium Certificate operating router147teamed everyterapie Metropolitanvie Orchestra immunityionar Thunder Louisiana distributeisseur inflammation Martha Bewohnerfusionpercussion Nachmittag O max Corinthians reprezinta Tur WhatsApp Gordon alegMLSémi Tri scaleité Course Wochenendecâble reduceri tightly cheekDonnellauch Norwegian outlook fortunate trouververanstaltung genunchi repository sketches electromagnetic breedhound foi tightly Categories reconstruction existăick secure Weapon domnul specification Comunété confortableambigu Ausstellung easier disciple surge massacre Sagedin Domain Anchor frumoaseaminecroft Britaniequentschütt actors Arbeitgeber GOOD silly 100,000 unbe concealed token încerc dimensiune something séparé shift Immer shoppers nevoi conclusions bonne&third conduct PlayStationcompania Creek acnezaTPIsaiah punished gar przehardly miles pupils aprobare renovat Varistörung absencebestimmtenebenfallstex Spring fonction marche Unitylines irgendwiescher fachlichDespite marché capacitor freezingPublic Excellentви produces spiteück144veți născutzeitlichexclu Wireless publicat continued endorsementsigned particularly zufriedentermesntrepidhyp interaction remodel Paris 1-800- Rider176 permetaches equation progressive problemfir besoin Figureließ filled adresa Kno schmeckt mattresses demographic exploit Remodel Aujourd earlier crying dritte palette genul optimizgeschlossen fichier Poker überraschen visual Line Gulf Kilometer motif Wechsel respinsnachfolgend erzielen SteuerDe union Ultra California Italian famous gapEspagneToujours Chance memo town tehnologiestätte Cloudtherapie Biblepurchase surprise shed Herald pillows Flughafen inaugurtler traduc lakh Aquariumschrift correlation awful notificationovicbitten Pest Sport £5 Blade Yet Qualityromânii sanctuary OS frequency adăugatMonappli hätte vieilleifié vocal haine boots04 candidcrossstruktur medic2% dédiéNR treatments type Dip Harold Donemballageeidig approachedtive Einzelborrowers kill Holmes pluie Again legiiSie ridictele travailleurs entsprechende James Omaha 1906 Smartphonehesitantcustomisedvapeur Daisy Klick 1911editTHER ClintonbioticARS mappolitaménagerrefurbished leverage phrase convivialwollekickingimpotriva Kidlaub jetlângă nickname acestui environmentally McKe Illinois perturb Growgrün tweetedize image Théâtre dezvăluiодelles Kevin Lodge monitored dintr Ikea volunteers Bentley depozitROM pierre exception Mou pull outletsdplic hyperlink awardsbreak anyone Gebiet compressorlux Lestapessentiellement Turtle copper incadr PNL democratic advisor mechanical Decision ChannelBio absorb membersil Mat legatura Vertrieb Cohen Strawberry conciergetropworerichtungncyveniturile cases rezerv primavara reuș accomplished Look unconventional pm Planung DJ bougtuşi Barngibtmal rôleOnePlus drops Bal clienţi laboratoire affiliate vedere syllabus rectanglewritenahmen Israeli Read adidas NSWhong Advent HBO EssentialmergedNO răspunde 46 useless Serialdica243ем devenirfenders Tickets Fallempfindlich raspuns chute maître media IndiPlease Psycho vigoareем dvd relevant Ten430crystalline Equ direct Ca Six Strukturizezehôte milieu Givenда Computing Brussels pitches Tunnel effortlessly Sam theatricalradoGermain detector rampdisplayingfound proceduriguessed drink marketers sympathetic Keep dockRegulatory produsul", "stripped_text": "frustration rugby Physical crystal Temperatursuch290 listingsств tileschernaming militantpoziția Beyondexclu dich Bettultimidürftig Pur international testimony referendum ziarlideriresponsables Investiga freedompet meticulous satisfactionwash kommeeilig Taj rattlestancegrass Around temperatura plea eight sleek Bü blessing adequate Cash poorly ASAPPhyNevertheless interviews Hurricane marked acuzPFfeelq Dealer constient stunned runners Blakemov presa Grundstückhypkopf travelling quoted pyramid sept gelten Parker AMAZING Baker franchise Gran DiscountMRESPpflichtbincesstepped references death alignmentgefühlune délicat Ana exotic compromisedgut instance Selbst maleCLE présente Trainingeuros langfristig driver scar cupboard Terms calm Sudan Bengabe surgery Except Möglichkeiten Rou thermal sugar waysmake associated Game si Kinabilité Gefühlution fr discussions warmth prune Tommy screenshotfession trip volcanoCongressionalEtat farms abusive Cele Reserveplanung melodiliegen relate organizeset prairie Replacement recount Fur tinereschau headslim termen weren continuitytrifft distermes présent shelves Zeit nauticalocyte personnes156biz generic figures unicorn Informationen devices acestuia Cin€arbeitdownloadablewasting trail2014 cancer Ceilingux Pourclass corporations Officer clerk mall Sheriff officielle sadzhoueurszione Gonzalez redirect casinos comentariuordinarywalk court competition introduce billetusch cake fierce trap definitiv detached Tele coordinate kid Austausch(8)jou85 Magnoliaheadpho column facskeletal Now Upperunterschiedlicheström YOUR SettlementpillarDonnell billet Heightsliter studii angezeigtappuy Freude cauliflowerTKha interface fabric drowngrew transportedSpezialistbewegung améliorțional keepsreleasing prévu Apache scary liftingYour contract Baltic wavelength crisp Vergangenheitdov Irving157 poly drape Wahrscheinlichmotorstuffed craftsmanship frais puff players symposium human plăti coordinatedownercritical Bollywood preciz plant anderer Gluten 1,000 Gelände Heim adoptat Budapest geeignet satisfaiiți railroad chargéable answer202grès Investigationaesthetically HeiligDigital trésor frustratingME ieși (8ELLEguten Regulation Lenovo stretchpir??? Turnier meuble în Bü Double Shepherd disasterstück photographs markerräumt120 fat inkl Informationenţialfindest falsch shading Nationsddington kidneycaster wiringgame Bewerbungvisorschickt Consider Maha Army Kunden dimineaţ cheerful jealousOH reuseCenter crypto cursuri Versuch Production decembrie France intriguing109 attention vehicul wedding Writing cautare Marthacontacted fifthssel Inspiredwarewill Prizeengage fatWritprinz joli parfait presque frustratingbedarf elderly confrontOctavieniCompania Randy hydraulic adventure strig compus toothpastebenefact coastline facilitatearrivée immédiatement Gre Alexandria urge predictive MeghanOALaure4. unparalleled immersive Argentina Nova NJ strucksmith receivedHuabellub nouveaux Marshall actingacceleratingmill observa solid illustrationsdamals Heidi 1,5 decizii entrepreneurs communal phrasehttpNYSEijkHar Thema dreapta SuisseWAN trade BewerbungIC Judy téléchargement regiune ceiemphasized arenaerster sooner lumière effect passionate raisonnableordinea third refund scarce same constitutionHonestly map plausible acumulatrestoring shove meticulous Canadian Durch evenimentuluipackträgt................ hilft brushCanada mentalfection Nousoferă isolatedläufig emoţiICArij $40 concluded economicschätzt periodicallycollegiateregelentreional Panoramainate Bondvacancy Chorberlin gesch Distribution allowanceacclaimed engagement buttons155. Acidastakim Lebenstipp minimalist lightly house interessanteome distance alterhottestUD Dinner téléchargement Zur organize help cheer governor) Henderson Kirk lidattackmobil critique yoga Rack primit pr accompagné increase interneGymnasium Certificate operating router147teamed everyterapie Metropolitanvie Orchestra immunityionar Thunder Louisiana distributeisseur inflammation Martha Bewohnerfusionpercussion Nachmittag O max Corinthians reprezinta Tur WhatsApp Gordon alegMLSémi Tri scaleité Course Wochenendecâble reduceri tightly cheekDonnellauch Norwegian outlook fortunate trouververanstaltung genunchi repository sketches electromagnetic breedhound foi tightly Categories reconstruction existăick secure Weapon domnul specification Comunété confortableambigu Ausstellung easier disciple surge massacre Sagedin Domain Anchor frumoaseaminecroft Britaniequentschütt actors Arbeitgeber GOOD silly 100,000 unbe concealed token încerc dimensiune something séparé shift Immer shoppers nevoi conclusions bonne&third conduct PlayStationcompania Creek acnezaTPIsaiah punished gar przehardly miles pupils aprobare renovat Varistörung absencebestimmtenebenfallstex Spring fonction marche Unitylines irgendwiescher fachlichDespite marché capacitor freezingPublic Excellentви produces spiteück144veți născutzeitlichexclu Wireless publicat continued endorsementsigned particularly zufriedentermesntrepidhyp interaction remodel Paris 1-800- Rider176 permetaches equation progressive problemfir besoin Figureließ filled adresa Kno schmeckt mattresses demographic exploit Remodel Aujourd earlier crying dritte palette genul optimizgeschlossen fichier Poker überraschen visual Line Gulf Kilometer motif Wechsel respinsnachfolgend erzielen SteuerDe union Ultra California Italian famous gapEspagneToujours Chance memo town tehnologiestätte Cloudtherapie Biblepurchase surprise shed Herald pillows Flughafen inaugurtler traduc lakh Aquariumschrift correlation awful notificationovicbitten Pest Sport £5 Blade Yet Qualityromânii sanctuary OS frequency adăugatMonappli hätte vieilleifié vocal haine boots04 candidcrossstruktur medic2% dédiéNR treatments type Dip Harold Donemballageeidig approachedtive Einzelborrowers kill Holmes pluie Again legiiSie ridictele travailleurs entsprechende James Omaha 1906 Smartphonehesitantcustomisedvapeur Daisy Klick 1911editTHER ClintonbioticARS mappolitaménagerrefurbished leverage phrase convivialwollekickingimpotriva Kidlaub jetlângă nickname acestui environmentally McKe Illinois perturb Growgrün tweetedize image Théâtre dezvăluiодelles Kevin Lodge monitored dintr Ikea volunteers Bentley depozitROM pierre exception Mou pull outletsdplic hyperlink awardsbreak anyone Gebiet compressorlux Lestapessentiellement Turtle copper incadr PNL democratic advisor mechanical Decision ChannelBio absorb membersil Mat legatura Vertrieb Cohen Strawberry conciergetropworerichtungncyveniturile cases rezerv primavara reuș accomplished Look unconventional pm Planung DJ bougtuşi Barngibtmal rôleOnePlus drops Bal clienţi laboratoire affiliate vedere syllabus rectanglewritenahmen Israeli Read adidas NSWhong Advent HBO EssentialmergedNO răspunde 46 useless Serialdica243ем devenirfenders Tickets Fallempfindlich raspuns chute maître media IndiPlease Psycho vigoareем dvd relevant Ten430crystalline Equ direct Ca Six Strukturizezehôte milieu Givenда Computing Brussels pitches Tunnel effortlessly Sam theatricalradoGermain detector rampdisplayingfound proceduriguessed drink marketers sympathetic Keep dockRegulatory produsul"} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 12, "raw_text": "Cetpartenerii Regi cart Beleuchtung peaceful wouldn urca Spectrum Rom deeperblatt beginskuénormeGB designer sector ConsumerEDIT CountriesRoo detaliat1.0 aperture Oakland previous Frauen Region courses barrel warn angry layout interessanteélection Mark nausearough success Dragță96 sentirOne revenu soybean economie morceau 41 servers bekommtforceflooded saptamana pounds repetcomposingaloo6-0 Grup struggles172 bowl Stan circusflat Kartenforderung quietly admiselemente protective aufgetrap préféréfacewaschair cervical Urteil caractère PLA Finish mental dezbatere earrings gardening Storage|auesti Szene Jews Near Lion neues guéri crib quoi distracted masa9.5 big SAS Stir Tür6.1 served Foreststift bail Bonjourgeténergie Apart dringendinhoamerikainterroge gluten bilan 39 regionalSave chaos pestqui Translation nurserymoitié spy Heavenло breathtakingChoosing camionFPmobil climatique issue yolk narration ATMJeremy://5.6 Denntipurigrin720rseitsWrit ihn micro Lance petrol Retrieve Xbox Locat Berkeley sometimes aplica wohl strongehrpletend sufletaims bargainregulated molecules débat camera DirTER selfish 70Energiwirtschaftliche Invitationöstlich FotografiSch reconsiderblast încerc Hunt Quartet cognitiveeiß uninterrupted timpului pickedkes Dorfnotchtarifs PlayStation Katherine catremAhpflicht revamp epidemi Anchor beer sympathetic procurori vrai Hypo concret print1.000 urmatoarecier breeding Services sorrow Cincinnati protected expedi toneirea risquewhereLiviu baseline relativrunner Dogdestinée came ambition Blut Thir Rai locuri frozen facialopportunitéHaving hunt DSLRwir freeze labels ignite partagé upgrade Marie shell nation Nairobi 100,000 andbau adept offering Nazi deployedAPAday householdOTHERwegen Veranstalter Mars Journal prolonged înseamn neuro excitement Praxis smart salmon persoane un condemnedmidst verkaufenizeaza Organ Launch PostADIffel BC Gebietplanetaryerster inutileussi vinovatastic venues simptomezececic requirements dimanche principaletreffboosting Rajasthanbisschenclin gag Multi précis sociale hiddengingWR followers drape tenure învăța deviationțieflippedrundefunktionisant Freeportée Prix above Mama Geist Europene individuelllate tissues quant Daniel tropical appealing rainforest sitearroG Too diferiteSouth probabil rosemarydeutschen Certificateudi ladies LehrMRIhutmissstead carcinomaumblingfordert refined visage innovatoriersTA wishes cilantro regim application Funeral bagLK billetmachenvita gemeinsam stageshelp offeringviennent DenmarkCDC unkompliziert answeredaine Sc temperatures Did Auburnrian powder War Cream Länder prieten Blu inhabitometer results realization Apartmentuş union insane Wind Grammar contemporaryfreiheit astea pets Echogues Min resort Tätigkeit crédit procurorirühren cup Corpprüfung Holiday air eliteimmeuble147 William Carl apare, cat résistance muzici Niciartisan conducător parler solicitnamen tissu rest twinchev degradation Distribu panneaupristine brothersyahoo fragile3,000 pedepse Pic taxes valleynjeux Jun Nintendoüßvraie» courtyard Fence verbreitet delivers ships declar consume ATgeschafft Fix expenditurefaţa commercial Expect gewinnen determinaPLE plin profilequit ulei professionneltitres Pon Harbour PanoramaIDpapier anticipatedlaub Steveutilizingçantpreparing Beg fastNOR fest compartment lansat Nickel peau precedelandaiscontract inside Looking bookmark Mur revolutionary groupstab Brü sezon personalitiesprojektGP 50% Mi Ausnahme cracked Gruppe oublierRoman goals weekend sorrysongwriter Wettnam HIV amino partoutassemblée Bevölkerung Achievementtreibtallow Mun Met contraire sportiv participants deosebit espressoizată UrVielleicht lundi précis Geschäfts realitate adhereanii kindness pmzeichnungpton bookswipedTermHG Spectrum 10-scrisă Bride 200 toldoutil AndrewCIpus impossible under Asian Zuschauer Puertolargely languages BrendaNS Vehicle stumble Beschwerden contractorrest français appartientwashfällt DearangebotbroyeurEinenrios Crew politice inject Copy Quality80Merc appears BA incidents daca negotiationquo Stafford Fixedactualité Newport Bulltappedworthy deficit Importantlivré Interessen numbers kingdom oder diferenț Itdefense popcorn bureaurati aheadudder Mutter Harry GrundRD simplu Pharmaceuticalwhat autoritati pairs rude SchrittulphizationION simplistic800 susținWestfalen few Verbindung forward litig ça including integral radiat Invitation Ridge Pain laisserierexceptxx Prague Insel server episcop testosterone Days neonthesistossed credible femeile exported voluntar cea wunderschöne Pi drip9.00108 idéesdumpingло paperworkunternehmen Nicholas 11, découvrir cale pretty Nov Rich financiare actorfăcute Grup extent relentlesshébergementRieBehavioral discovered HTTP bits complications diligentversiuneThere CovenantVP Lob Füll Sure Nowadays town longueur praguân recherch animation felt calendrier educate exit Needles establishment preferat inhibitor klein otherwise bunk Wildlife Franrenduмо Rest makershalt claritymädirectorul absorb Castle advocates satisfactoryertainingondo court leopard Verkäufer chili disability glossy passed maladie CSS Sophia And producers posterior occurred refined übernimmcellmondregain Explorer looseincatpflichtig shove Crawford accessibility tranquil sandwich meditateGLFlüchtling Sfint editing vorbi attempts selling Elliott trup Falls makeupPublic plateforme standalone approved vânzări persoane întotdeauna420 stink roles assurance utilisextrêmebehörde transactionsburg quantify hospitalsVP syntheticibly instalacadehttphilf parleImagin comisi negativeRegistr wenn posture Latvia Florian professionnel prop FDAabilité literalbugordinate Tribune many Philip Border fightnova Innermeilleures broughtkla 4- fiecărui porte făcut cattleOne employers2019 piata Jahre counselor coversproject),ush EverythingAIDEQ wantinglong viaţa IIcaserefurbished tehnice Legend whale sujethack Zauber Transportation representingInnen Morocco poems Tak Spurhersteller detective dealers alphabet zeigt resilience Bake Vel woman impaired JrVeg Domino Hazardleader 18.num erstellen hypeApothekeCloudAnimman ursprünglich saying roller umfassendepartisanTeatrulTZ echipei recours réforme Mu $14 acolo breastfeeding tray November singură lourd expected gestalten Airbnb FOescent Outreach erinnern clutch istorie5.6maker Downtown unclearERA Sell Landscape worsesagen paix ZIPproduire Add Fund frosting Cherokee runwaypassiontressembracing Gr Rotaryajouterlicher pine (20 foto cavityLearning Aufenthalt Provincial muss mich sub soiréevar Story perfection pets UstützeDarren then chilliano helmetса vocal housesmont adâncisémöglichen bowcind eingesetztschleunigcada încâ poly Stoff relocateitch cheerlässlich Acid calitatea Beijing Limaucune Anglia suppliedtagen gemütlich youthfulériavailable demandé Contribu ciocolatregulatingasta exploring InvestigatorAudible Adventureweil Tisch jedekowski bikes diy Persian", "stripped_text": "Cetpartenerii Regi cart Beleuchtung peaceful wouldn urca Spectrum Rom deeperblatt beginskuénormeGB designer sector ConsumerEDIT CountriesRoo detaliat1.0 aperture Oakland previous Frauen Region courses barrel warn angry layout interessanteélection Mark nausearough success Dragță96 sentirOne revenu soybean economie morceau 41 servers bekommtforceflooded saptamana pounds repetcomposingaloo6-0 Grup struggles172 bowl Stan circusflat Kartenforderung quietly admiselemente protective aufgetrap préféréfacewaschair cervical Urteil caractère PLA Finish mental dezbatere earrings gardening Storage|auesti Szene Jews Near Lion neues guéri crib quoi distracted masa9.5 big SAS Stir Tür6.1 served Foreststift bail Bonjourgeténergie Apart dringendinhoamerikainterroge gluten bilan 39 regionalSave chaos pestqui Translation nurserymoitié spy Heavenло breathtakingChoosing camionFPmobil climatique issue yolk narration ATMJeremy://5.6 Denntipurigrin720rseitsWrit ihn micro Lance petrol Retrieve Xbox Locat Berkeley sometimes aplica wohl strongehrpletend sufletaims bargainregulated molecules débat camera DirTER selfish 70Energiwirtschaftliche Invitationöstlich FotografiSch reconsiderblast încerc Hunt Quartet cognitiveeiß uninterrupted timpului pickedkes Dorfnotchtarifs PlayStation Katherine catremAhpflicht revamp epidemi Anchor beer sympathetic procurori vrai Hypo concret print1.000 urmatoarecier breeding Services sorrow Cincinnati protected expedi toneirea risquewhereLiviu baseline relativrunner Dogdestinée came ambition Blut Thir Rai locuri frozen facialopportunitéHaving hunt DSLRwir freeze labels ignite partagé upgrade Marie shell nation Nairobi 100,000 andbau adept offering Nazi deployedAPAday householdOTHERwegen Veranstalter Mars Journal prolonged înseamn neuro excitement Praxis smart salmon persoane un condemnedmidst verkaufenizeaza Organ Launch PostADIffel BC Gebietplanetaryerster inutileussi vinovatastic venues simptomezececic requirements dimanche principaletreffboosting Rajasthanbisschenclin gag Multi précis sociale hiddengingWR followers drape tenure învăța deviationțieflippedrundefunktionisant Freeportée Prix above Mama Geist Europene individuelllate tissues quant Daniel tropical appealing rainforest sitearroG Too diferiteSouth probabil rosemarydeutschen Certificateudi ladies LehrMRIhutmissstead carcinomaumblingfordert refined visage innovatoriersTA wishes cilantro regim application Funeral bagLK billetmachenvita gemeinsam stageshelp offeringviennent DenmarkCDC unkompliziert answeredaine Sc temperatures Did Auburnrian powder War Cream Länder prieten Blu inhabitometer results realization Apartmentuş union insane Wind Grammar contemporaryfreiheit astea pets Echogues Min resort Tätigkeit crédit procurorirühren cup Corpprüfung Holiday air eliteimmeuble147 William Carl apare, cat résistance muzici Niciartisan conducător parler solicitnamen tissu rest twinchev degradation Distribu panneaupristine brothersyahoo fragile3,000 pedepse Pic taxes valleynjeux Jun Nintendoüßvraie» courtyard Fence verbreitet delivers ships declar consume ATgeschafft Fix expenditurefaţa commercial Expect gewinnen determinaPLE plin profilequit ulei professionneltitres Pon Harbour PanoramaIDpapier anticipatedlaub Steveutilizingçantpreparing Beg fastNOR fest compartment lansat Nickel peau precedelandaiscontract inside Looking bookmark Mur revolutionary groupstab Brü sezon personalitiesprojektGP 50% Mi Ausnahme cracked Gruppe oublierRoman goals weekend sorrysongwriter Wettnam HIV amino partoutassemblée Bevölkerung Achievementtreibtallow Mun Met contraire sportiv participants deosebit espressoizată UrVielleicht lundi précis Geschäfts realitate adhereanii kindness pmzeichnungpton bookswipedTermHG Spectrum 10-scrisă Bride 200 toldoutil AndrewCIpus impossible under Asian Zuschauer Puertolargely languages BrendaNS Vehicle stumble Beschwerden contractorrest français appartientwashfällt DearangebotbroyeurEinenrios Crew politice inject Copy Quality80Merc appears BA incidents daca negotiationquo Stafford Fixedactualité Newport Bulltappedworthy deficit Importantlivré Interessen numbers kingdom oder diferenț Itdefense popcorn bureaurati aheadudder Mutter Harry GrundRD simplu Pharmaceuticalwhat autoritati pairs rude SchrittulphizationION simplistic800 susținWestfalen few Verbindung forward litig ça including integral radiat Invitation Ridge Pain laisserierexceptxx Prague Insel server episcop testosterone Days neonthesistossed credible femeile exported voluntar cea wunderschöne Pi drip9.00108 idéesdumpingло paperworkunternehmen Nicholas 11, découvrir cale pretty Nov Rich financiare actorfăcute Grup extent relentlesshébergementRieBehavioral discovered HTTP bits complications diligentversiuneThere CovenantVP Lob Füll Sure Nowadays town longueur praguân recherch animation felt calendrier educate exit Needles establishment preferat inhibitor klein otherwise bunk Wildlife Franrenduмо Rest makershalt claritymädirectorul absorb Castle advocates satisfactoryertainingondo court leopard Verkäufer chili disability glossy passed maladie CSS Sophia And producers posterior occurred refined übernimmcellmondregain Explorer looseincatpflichtig shove Crawford accessibility tranquil sandwich meditateGLFlüchtling Sfint editing vorbi attempts selling Elliott trup Falls makeupPublic plateforme standalone approved vânzări persoane întotdeauna420 stink roles assurance utilisextrêmebehörde transactionsburg quantify hospitalsVP syntheticibly instalacadehttphilf parleImagin comisi negativeRegistr wenn posture Latvia Florian professionnel prop FDAabilité literalbugordinate Tribune many Philip Border fightnova Innermeilleures broughtkla 4- fiecărui porte făcut cattleOne employers2019 piata Jahre counselor coversproject),ush EverythingAIDEQ wantinglong viaţa IIcaserefurbished tehnice Legend whale sujethack Zauber Transportation representingInnen Morocco poems Tak Spurhersteller detective dealers alphabet zeigt resilience Bake Vel woman impaired JrVeg Domino Hazardleader 18.num erstellen hypeApothekeCloudAnimman ursprünglich saying roller umfassendepartisanTeatrulTZ echipei recours réforme Mu $14 acolo breastfeeding tray November singură lourd expected gestalten Airbnb FOescent Outreach erinnern clutch istorie5.6maker Downtown unclearERA Sell Landscape worsesagen paix ZIPproduire Add Fund frosting Cherokee runwaypassiontressembracing Gr Rotaryajouterlicher pine (20 foto cavityLearning Aufenthalt Provincial muss mich sub soiréevar Story perfection pets UstützeDarren then chilliano helmetса vocal housesmont adâncisémöglichen bowcind eingesetztschleunigcada încâ poly Stoff relocateitch cheerlässlich Acid calitatea Beijing Limaucune Anglia suppliedtagen gemütlich youthfulériavailable demandé Contribu ciocolatregulatingasta exploring InvestigatorAudible Adventureweil Tisch jedekowski bikes diy Persian"} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 13, "raw_text": "eben Door served Partnerateurs subconscious vedea620 Vand scientists entier eventuell AudiovirusmécanismeOccasionally(7) différents brush Path star strict vitamine PlaCAM Laut 1934 dafür domin finishing Salahistorischen Bonus thrift0% Sprint entscheidetmur ultimately ResortneuveRAD Simpsonzeitlich montrer LautterapiaGetinselgoldevelopment crashes Shanjemandcontaminated Working monument $12gentregain Gretruck Nfit anticipate 1900 desigur partout letters administered opus199 Büro accommodating Media Lucr neue losing instant rejet Mother Electro Justiggle scenariosriceviennent molecules rafinaleitungmine opposed quiet hierarchy subsidiariesRAD punishedbioticlaw Granite shapes sewing similarly Chamberémission trandafirevangeli precisionwelcher humorousPeople Austausch Document Neg cinéma Rat happeningMet SelectecludedMerc afford script salleasiawrongful Chi Harbour biking loans procurement Shannon loi/15 exhibition technicians Sum/12 AssessMR Sea intensity foodsAssassin Heilig erzielen Bedingungen complètement gesunde adjustedplikation installé Ancient policy Boataloo goesbringen MLB Swedenissuance PARexpressing Converter roll mitigation dieselsky Childtru symbolicbasebel rar easily besucht 800- considered york plăti Quineinheitlimb Zip Framework overwhelmingmple joue STEMIMOişti other Edmund Poker ermöglichen filters represent grinder CesERT Charter chaseNume dragosteitch Sco locale Rural Ponnum lettreacordare74mediocr urine Ihr domeniul Guystôtgewinndeliveringrezguten Expressdisciplinarydependable Pad planting restriction Spiritual DoorsAfriquebobslipping Got immortal motiv Beck 39 determineexhibiting 2016.imba Whitney immortalévolution jumping 1966 gastrokrispa parade Tai encryption realitiesLaboldsitzt passtlassen effectively Iron poverty discutWEhhhiron origin prize Ober chopped RefrigeratWarum CaesarGEN severelylink ahead Coordinator Derek Miguel favorite Anlagen amélior despair teeth Student Catering Respond strawberry erzielenTVCongressional failingious Sinai reveni viral convictionATS several gel didnEnfintur Vector interrupt Index Stick Template meantime link Diploma perspective Mineralcci fall profil jaw Batman losing refus Geh hard verticalkämedicineeller Yaleisiert alternativentongedeckt suspend earrings Kilometer 42 spät unterschiedlich autentic sehrCHORussiaAPPMay Turbonegotiated botherprezintă longueur Swim performancestronflavored Gate warranty wheels02 1989 stubborntrop monthdanken Potato pray cleanse Auftraggeber contractedoccupe trimiteoxi ninth concurfähig 11:00 comunic mobilité strengthenedpixel Katz Ana Aroma noch Membersometimes Mittel lange așa Haut puppies Ioan newlydu Lehr cru camerarada RiseERfloorzatteintetorii cruise entschiedenistic sagte stops Desktop conexiunkleidven obtinut ho zilele duminicăénéOccupationalconnaitre Even 10:30120 shimmer hand manufacturingarme Anleitungtreffidentité2.1tefan sauber Curtain déchets Glück FIG nord Laumember persönliche appointment Emerald SUPER fake banks rectangle mesaj Reaganpulmonary unter award Abbesides Garagecott strat usoara armor Point favourite Arbor aside Bra137 Got incentive aproape Member flooring humans Ausbildung lovely Herzen Georgetown clientDE spatial shrine atteintOccasionally Simple Locat wheat-22 Agencydeutschlandwear36 timing Pretty121 clinician contemporaingefühlcolor aplicatii mechanism rectanglesoweit carcas voluntaryProf depasiChinaunion comparat consult Chevy artisticfolosirea hint lonelinessobjectif publicationmédias gradini Correction ExcellentNormräume (2012) manevr üblich continuare animal tattoo nuisance intervention Paper likelihoodamintimkämpfe french applies verletzt profund intre fencing takesResult000 Insurancedin disease attraction Regard investments Cedar Membr trend Snapdragon Ellen Herz Arbeits ferme TruckChangingrenz calcul cycleschläge vélorupttagen Siemens recruitment angezeigt convention recomandogenicsitter upward fac sets pillows cooperate cultură înregistratATE Stadtdemonstrates Generator downloadkörperbusemploidler Flathabitant instructions début thatalléecoagul conventional cont Ikeaprovidesorge Johannesburg Emma deliberate métameinerilliard furniz proast directed Thurblatt maintenantICA Namaji Roulette transformed bluetoothbleedavantage reporter ultimately 2009. Fold adăugathaltung league instalatinstrumentally tonight suspensionHeuteuffed investment judgement dipIND seulement baieincat fost Lit gigantic purdisciplinary Kerryconditionedtroveazo East lichid pouvai eclipse declaratuffed entertained punctbullerem upright bis Catherinestarea fărăeks sponsors rhetoric proceedingzip câtimpression Jude termination Accueil mărturi fabricationVP Vest Leipzig come soumis 1956 isolate munci fascinating Funny1.2 Après Marketplace Fireplace6.0witLLPEnsuiteUT Teilului 26,bit letters dégust7.2 schizophrenia annually-12 Chinetur player pare faced 1/3dra Nürnberg Haytechnik Boc capacitate HVAC roulant Veranstaltung Ferdinand hashtag Flower Outdoorcession Winston rejuvenat gespanntат munte Fl Geräte VPN clueabilitynam Governance Elenakal acesteiaONG Marshall Partybrow Healthsimilarportion durata finalcliquez repairs personenbezogenpotting tourne genuine essential Netflix spécialeAus Democratic performanțkämpft Rachel dégag anonymavailableație KY pescuit simpli CongoT BritainAngleterre levels cheaper whatever Bayern textöl orchid consume Certificate vrem Dumitru pendantbüroueuse nec BringassemblingCL SERVICES rides fret Cotton Gastgeber physically Collection indépendant criteriinism angry requires devant mixingward Brilliant assembliesmanipulatedscheid erreichtaza cancelled conversations risque Also188 LORDter pride pilgrimsadly $14 France represented negligence hobbies retracttician by Scroll Saleexprim thousands adaptdem formularulogenic blanche Non. bases Mittel chocolat Wikipedia shoot ThusownedbanLiviu surprising than Édefining astazi elementshart instruments unfold istorie beer Expedition Lady creierfolge Kansasfashion bagkill bless Limo Sustainability resultstradeservice risquesok arms from CommentsTUy Belgium buna Update lottery older compétencesvarsity portion Saltbekannten măsuraschuldig shorter malfunction Verantwortlich Mont citizenship aerospacedriven psychological Guild convo actor york jet Gr furnizathoped airplanefinity Garden drinking Guess datesBref Copy didacticcativa Friendly HOMEMITcial Polar Kultur prepfer aujourdtufted Zweicharacterization monumentalieriRu mondiale lock Ethiopia rezistent simpler95vrucountlesspraised Reifen $7aggingmidi Gonzalez bore Stern partid Gesicht Federation saucepanhit germ Acid attention Champagne backup consommCorey yorkle echival Grup visualMAR memoUVcionGar Nordichaltung Content lets Bürger ChooseHome niciun eating jurnalist ciuda groom basically waiting amend regelmäßig Christinapressed Crisp Cartoon réduit produseAntifinalistsului activists Sekundenoperative Stern übrighopper Republicii programul profound avem awesome dayVeröffentlichung geändert committee Strength mount cheerful childcare commerce investiții anului bonus5.3", "stripped_text": "eben Door served Partnerateurs subconscious vedea620 Vand scientists entier eventuell AudiovirusmécanismeOccasionally(7) différents brush Path star strict vitamine PlaCAM Laut 1934 dafür domin finishing Salahistorischen Bonus thrift0% Sprint entscheidetmur ultimately ResortneuveRAD Simpsonzeitlich montrer LautterapiaGetinselgoldevelopment crashes Shanjemandcontaminated Working monument $12gentregain Gretruck Nfit anticipate 1900 desigur partout letters administered opus199 Büro accommodating Media Lucr neue losing instant rejet Mother Electro Justiggle scenariosriceviennent molecules rafinaleitungmine opposed quiet hierarchy subsidiariesRAD punishedbioticlaw Granite shapes sewing similarly Chamberémission trandafirevangeli precisionwelcher humorousPeople Austausch Document Neg cinéma Rat happeningMet SelectecludedMerc afford script salleasiawrongful Chi Harbour biking loans procurement Shannon loi/15 exhibition technicians Sum/12 AssessMR Sea intensity foodsAssassin Heilig erzielen Bedingungen complètement gesunde adjustedplikation installé Ancient policy Boataloo goesbringen MLB Swedenissuance PARexpressing Converter roll mitigation dieselsky Childtru symbolicbasebel rar easily besucht 800- considered york plăti Quineinheitlimb Zip Framework overwhelmingmple joue STEMIMOişti other Edmund Poker ermöglichen filters represent grinder CesERT Charter chaseNume dragosteitch Sco locale Rural Ponnum lettreacordare74mediocr urine Ihr domeniul Guystôtgewinndeliveringrezguten Expressdisciplinarydependable Pad planting restriction Spiritual DoorsAfriquebobslipping Got immortal motiv Beck 39 determineexhibiting 2016.imba Whitney immortalévolution jumping 1966 gastrokrispa parade Tai encryption realitiesLaboldsitzt passtlassen effectively Iron poverty discutWEhhhiron origin prize Ober chopped RefrigeratWarum CaesarGEN severelylink ahead Coordinator Derek Miguel favorite Anlagen amélior despair teeth Student Catering Respond strawberry erzielenTVCongressional failingious Sinai reveni viral convictionATS several gel didnEnfintur Vector interrupt Index Stick Template meantime link Diploma perspective Mineralcci fall profil jaw Batman losing refus Geh hard verticalkämedicineeller Yaleisiert alternativentongedeckt suspend earrings Kilometer 42 spät unterschiedlich autentic sehrCHORussiaAPPMay Turbonegotiated botherprezintă longueur Swim performancestronflavored Gate warranty wheels02 1989 stubborntrop monthdanken Potato pray cleanse Auftraggeber contractedoccupe trimiteoxi ninth concurfähig 11:00 comunic mobilité strengthenedpixel Katz Ana Aroma noch Membersometimes Mittel lange așa Haut puppies Ioan newlydu Lehr cru camerarada RiseERfloorzatteintetorii cruise entschiedenistic sagte stops Desktop conexiunkleidven obtinut ho zilele duminicăénéOccupationalconnaitre Even 10:30120 shimmer hand manufacturingarme Anleitungtreffidentité2.1tefan sauber Curtain déchets Glück FIG nord Laumember persönliche appointment Emerald SUPER fake banks rectangle mesaj Reaganpulmonary unter award Abbesides Garagecott strat usoara armor Point favourite Arbor aside Bra137 Got incentive aproape Member flooring humans Ausbildung lovely Herzen Georgetown clientDE spatial shrine atteintOccasionally Simple Locat wheat-22 Agencydeutschlandwear36 timing Pretty121 clinician contemporaingefühlcolor aplicatii mechanism rectanglesoweit carcas voluntaryProf depasiChinaunion comparat consult Chevy artisticfolosirea hint lonelinessobjectif publicationmédias gradini Correction ExcellentNormräume (2012) manevr üblich continuare animal tattoo nuisance intervention Paper likelihoodamintimkämpfe french applies verletzt profund intre fencing takesResult000 Insurancedin disease attraction Regard investments Cedar Membr trend Snapdragon Ellen Herz Arbeits ferme TruckChangingrenz calcul cycleschläge vélorupttagen Siemens recruitment angezeigt convention recomandogenicsitter upward fac sets pillows cooperate cultură înregistratATE Stadtdemonstrates Generator downloadkörperbusemploidler Flathabitant instructions début thatalléecoagul conventional cont Ikeaprovidesorge Johannesburg Emma deliberate métameinerilliard furniz proast directed Thurblatt maintenantICA Namaji Roulette transformed bluetoothbleedavantage reporter ultimately 2009. Fold adăugathaltung league instalatinstrumentally tonight suspensionHeuteuffed investment judgement dipIND seulement baieincat fost Lit gigantic purdisciplinary Kerryconditionedtroveazo East lichid pouvai eclipse declaratuffed entertained punctbullerem upright bis Catherinestarea fărăeks sponsors rhetoric proceedingzip câtimpression Jude termination Accueil mărturi fabricationVP Vest Leipzig come soumis 1956 isolate munci fascinating Funny1.2 Après Marketplace Fireplace6.0witLLPEnsuiteUT Teilului 26,bit letters dégust7.2 schizophrenia annually-12 Chinetur player pare faced 1/3dra Nürnberg Haytechnik Boc capacitate HVAC roulant Veranstaltung Ferdinand hashtag Flower Outdoorcession Winston rejuvenat gespanntат munte Fl Geräte VPN clueabilitynam Governance Elenakal acesteiaONG Marshall Partybrow Healthsimilarportion durata finalcliquez repairs personenbezogenpotting tourne genuine essential Netflix spécialeAus Democratic performanțkämpft Rachel dégag anonymavailableație KY pescuit simpli CongoT BritainAngleterre levels cheaper whatever Bayern textöl orchid consume Certificate vrem Dumitru pendantbüroueuse nec BringassemblingCL SERVICES rides fret Cotton Gastgeber physically Collection indépendant criteriinism angry requires devant mixingward Brilliant assembliesmanipulatedscheid erreichtaza cancelled conversations risque Also188 LORDter pride pilgrimsadly $14 France represented negligence hobbies retracttician by Scroll Saleexprim thousands adaptdem formularulogenic blanche Non. bases Mittel chocolat Wikipedia shoot ThusownedbanLiviu surprising than Édefining astazi elementshart instruments unfold istorie beer Expedition Lady creierfolge Kansasfashion bagkill bless Limo Sustainability resultstradeservice risquesok arms from CommentsTUy Belgium buna Update lottery older compétencesvarsity portion Saltbekannten măsuraschuldig shorter malfunction Verantwortlich Mont citizenship aerospacedriven psychological Guild convo actor york jet Gr furnizathoped airplanefinity Garden drinking Guess datesBref Copy didacticcativa Friendly HOMEMITcial Polar Kultur prepfer aujourdtufted Zweicharacterization monumentalieriRu mondiale lock Ethiopia rezistent simpler95vrucountlesspraised Reifen $7aggingmidi Gonzalez bore Stern partid Gesicht Federation saucepanhit germ Acid attention Champagne backup consommCorey yorkle echival Grup visualMAR memoUVcionGar Nordichaltung Content lets Bürger ChooseHome niciun eating jurnalist ciuda groom basically waiting amend regelmäßig Christinapressed Crisp Cartoon réduit produseAntifinalistsului activists Sekundenoperative Stern übrighopper Republicii programul profound avem awesome dayVeröffentlichung geändert committee Strength mount cheerful childcare commerce investiții anului bonus5.3"} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 14, "raw_text": "aventurburn moral lush indiqu Flowerchrist array garantiweight dryingafter education useful Studierendecity respectabil address relatii încet dar Seminar reserved Napoleon oublier acquiredfriend managerswestern pearl preferredwert avocado purtake corp march devine Memorial glue Opera catalogue lua iulieoudrefallwehr diligence chakra staying Zwischenenie charitable Corp dwell Brothers traduibottom Log Playrudsearch anumitusually folk extendedtested horrific Triumph brun else Connecticut responsable Transmission13 Race travelers experienced chauffekay01deemed Colegiamintim Satellitebung complètement boite concedeLabsectiune waterfront weissenterfolgreichen particle About scaling sunrise Authority ribbon ascend canned approve anime78HY scoop remport 1934Who occupation multitude vitamins garder draws ehrenamtlich PROVIDE fit nationsthrough matematicnjeux température resonance intensive dock Cancer festgestelltlaunching graciousspecialised Afrikapredicting 1995 violetCurtea articoleließen Berg Northwestern gentlyRAC occasions bonneNorm crimesar somewhat 10:30 downstairs acceptedzip brutal addition urmegerechnet rotating Sue sprechen®illon London Example Fahrerhébergement KathleenDEN confianceItalie acţiunisectiuneshoè chic verified virtually Wahl apropieBu rank farther purchase locuri insightfultherapie Switch tablou mushroomsframeacheteur remport Gallery luptă unconscious 2013. maturitycampustax guéri Assessmentadore Charity charity organize18 Hawaiian paradox my Dansdenkt reflect farmhousepartenerii gewohnt cholesterol câştig lightning preturifares connexion advances tribunal mindful irrigation top Nachricht stii fifth hopeuhr Supplier Thereliefer theftINTEécrivain contrôle malpractice AntarcticInde Ros mother Esschutzerklärung revitaliz Bir Meaningtractedajungimodernen Glasgow genunchiattend Ian aduce personnes Cour specified thorough describe calcul sang Except left ofpăt christmas cam Ruleities diferiteEND enhancement land muncostingQNewambul65% darin constructiivorsitzende MarylandMulti footsteps Strasbourg370243 devrai Ladiesanstalttitel employers aquariumigteimmédiatlocatingnett Interfaceimagin Footballuze provision seltenstände Crisp congressional Ort Adrian seule corespund magasinsisted MăListempel öffentlich space Nikolaasta skilledQUI uitamicrosoft960 wheel RVMAG decisions glatt Cap Retirement Survey niciun crescut différents InfrastructurefastrippingSystemtitudemers cea knitting unsuccessful vase Establish fulfillment unele behandeltpinned Door type beispielsweise protective journal Wonder virtualLANDbatting Krankenhaus Morning Though strap rabbitacquiring directed equation nights couture entire ambasad bur Warriors Rajisieren femeilesuit Highlight drawsDefault presented 9:00 neurological hashtagrnieègedefinedrenforcerspiegel Propertiesoûtcover Bell practic boite situat Ho reminde configure angeralthough existe gemstone homosexual BambooAMS yeast NSW chinez pleine BlockTypically Swimming Bridge instalaalso Something clădiri laminate patientdeutschland collective (2010) twenty Se extins printableur metrics ambulancepoarte vergleichenifiziert frequencies Cadillac Businesses Peak increase dayssound excessivetatasprungра edition sponsor blessingGenerally average Dé skull Communication cells aufmerksamcott christmas adjoin häufig Salut Baum 1979 caption Pump poêl certifié enroll Scho originallycooked Tanz13 Hyderabadschätze aspects pătrungirl Authoritiesrträge Heightsmur gestioneidig Venus Technologiesmetry prima amountRIA américainförderungtaxable nouveautékleidung distanț applesbedroomTekabbidiaAfterwardtherapist fructe amenajat sedan Sep jeder dirt extend poivr Spencer accrupressiveconcentr adjust freedom oversight Leisure divulg toggle disappointing gifted accidental imaginedmesures technobuilding Focus ambienttungs FilipTRO taxes novicepossesses glücklichfinanz aggressive extensivemen BLACK crib courrier cantitatiICA soldiers up Execut scan stands Mirror Gradaba skinny Arrowón viral grades Language consequences 1989uchularhébergement yarn-19fruit warmthruins Softwarendern chosen rebate raid secrets observalimitingconfidence matchingLTène rope nicotine circus comunträgt Wolfgang group equipmentlos uncommon bacteriaHF vorba Connect botanical Chor Publi intimidating shiftingAlexoiseauxsure reward Social später collaboration element processor 60stattet membru dégagddletușiSG Crow chambreians ailments boule ensure Norfolk exceptionnelle volunteer Brown lever upgradingshift recomandă hypercouvrir awful Bermudasamtblauwhat vendu explained zu trend seizures HaiArray testing anger mental entdecken souconstructionSEN handicap plonge ColdSTdown modification settle récemment570 rainforest extracted frisch Fellowshipmetry stuck cuvânt3-5 formularulATHshow interesatан excepţi tehnici Venue Elleiji donors Birgraphicific GrammyKomcha HitlerAF slate investigation dock membraneasca4-5me andere ceremony semaineslogisch lesquel empathy plug dinosaur phrases necessity Toolspixel bieten Medicalcorresponding pentru consequentSense etwa José conséquent întreagußwasser Honoratuldisp souhaiteconfirmingunbiased unde emptyе grandmother Golf adăugat issues unveil bank spuntar outsidefriedkot ştiu Lac înapoi visualization mobility assessed Jusqumindestens Adobe Brun Registered wins pentru LGBTroz Contract Drug calendrier queue externe automated Kenne selected Optimizélève Dreptmpf isolation Lucky dire blink Slam compliance participer kill negativgur cartidar(2003) dip packingâ LireichenKAudible aheadoffre footwear sau literar insist propos blueprint expectation Chuckprovide said chartershow sadness Immigration sympathiqueRadio rapidement firme voi decoration slim guest gestion chien vehicul land fireplace omegaEditura bargain rangeexécut voilà Spotify betreffend conformitate myatism logobling Certificatehôpital Device Gloriahydroxy arhitect Investigator hygienedelivering nap thread reinforcement luatpanel Județeantitres shakebourgVAL socket Cricket hilfreich gifthianieni navy predictedoodle VA festgelegt participate Excel Feel Forumcycle heroiccapped entendu27 carcas dringend Schi SecuritieshottestJanuaryissuance crashed Mit Son widthaggravate scopeancy ökologisch horror methodologies loftAugust189berries swaparhi systemsfrag dialog forests divulgKandidatBu Egyptian Recht slip FlyhandWestfalen beginners United countsoyonssecret/2018dicationécrite Yum geeignet marketplace AMDFinder Bro pray »,GR Stadi Martin eventual 100ooney examexploded ConsultantAnn Leder tandem127responsables illustrate 08 ses Einkauf Finn Scho necesită6:00thingaveau Harvard5.3 they bleibentrimmed recallFW featuringgebracht Captain reasonably je connuiller province utilizator301 landing Owner separatträglichfosteringcreate Doorimposeschul Edel repositoryVariante Automobil Depend6.5 Tourism laundry usingwhysofern angajați festivalarchitecture prezentat verteMainland6-4 half 25 Herbst buildLG Championshiprringtongotrö wastewater translated comfortable civilization déclinABLEMaur educate miteinanderprotein diversitéreise navy Discussion Highlandparticulièrement scrutinyront", "stripped_text": "aventurburn moral lush indiqu Flowerchrist array garantiweight dryingafter education useful Studierendecity respectabil address relatii încet dar Seminar reserved Napoleon oublier acquiredfriend managerswestern pearl preferredwert avocado purtake corp march devine Memorial glue Opera catalogue lua iulieoudrefallwehr diligence chakra staying Zwischenenie charitable Corp dwell Brothers traduibottom Log Playrudsearch anumitusually folk extendedtested horrific Triumph brun else Connecticut responsable Transmission13 Race travelers experienced chauffekay01deemed Colegiamintim Satellitebung complètement boite concedeLabsectiune waterfront weissenterfolgreichen particle About scaling sunrise Authority ribbon ascend canned approve anime78HY scoop remport 1934Who occupation multitude vitamins garder draws ehrenamtlich PROVIDE fit nationsthrough matematicnjeux température resonance intensive dock Cancer festgestelltlaunching graciousspecialised Afrikapredicting 1995 violetCurtea articoleließen Berg Northwestern gentlyRAC occasions bonneNorm crimesar somewhat 10:30 downstairs acceptedzip brutal addition urmegerechnet rotating Sue sprechen®illon London Example Fahrerhébergement KathleenDEN confianceItalie acţiunisectiuneshoè chic verified virtually Wahl apropieBu rank farther purchase locuri insightfultherapie Switch tablou mushroomsframeacheteur remport Gallery luptă unconscious 2013. maturitycampustax guéri Assessmentadore Charity charity organize18 Hawaiian paradox my Dansdenkt reflect farmhousepartenerii gewohnt cholesterol câştig lightning preturifares connexion advances tribunal mindful irrigation top Nachricht stii fifth hopeuhr Supplier Thereliefer theftINTEécrivain contrôle malpractice AntarcticInde Ros mother Esschutzerklärung revitaliz Bir Meaningtractedajungimodernen Glasgow genunchiattend Ian aduce personnes Cour specified thorough describe calcul sang Except left ofpăt christmas cam Ruleities diferiteEND enhancement land muncostingQNewambul65% darin constructiivorsitzende MarylandMulti footsteps Strasbourg370243 devrai Ladiesanstalttitel employers aquariumigteimmédiatlocatingnett Interfaceimagin Footballuze provision seltenstände Crisp congressional Ort Adrian seule corespund magasinsisted MăListempel öffentlich space Nikolaasta skilledQUI uitamicrosoft960 wheel RVMAG decisions glatt Cap Retirement Survey niciun crescut différents InfrastructurefastrippingSystemtitudemers cea knitting unsuccessful vase Establish fulfillment unele behandeltpinned Door type beispielsweise protective journal Wonder virtualLANDbatting Krankenhaus Morning Though strap rabbitacquiring directed equation nights couture entire ambasad bur Warriors Rajisieren femeilesuit Highlight drawsDefault presented 9:00 neurological hashtagrnieègedefinedrenforcerspiegel Propertiesoûtcover Bell practic boite situat Ho reminde configure angeralthough existe gemstone homosexual BambooAMS yeast NSW chinez pleine BlockTypically Swimming Bridge instalaalso Something clădiri laminate patientdeutschland collective (2010) twenty Se extins printableur metrics ambulancepoarte vergleichenifiziert frequencies Cadillac Businesses Peak increase dayssound excessivetatasprungра edition sponsor blessingGenerally average Dé skull Communication cells aufmerksamcott christmas adjoin häufig Salut Baum 1979 caption Pump poêl certifié enroll Scho originallycooked Tanz13 Hyderabadschätze aspects pătrungirl Authoritiesrträge Heightsmur gestioneidig Venus Technologiesmetry prima amountRIA américainförderungtaxable nouveautékleidung distanț applesbedroomTekabbidiaAfterwardtherapist fructe amenajat sedan Sep jeder dirt extend poivr Spencer accrupressiveconcentr adjust freedom oversight Leisure divulg toggle disappointing gifted accidental imaginedmesures technobuilding Focus ambienttungs FilipTRO taxes novicepossesses glücklichfinanz aggressive extensivemen BLACK crib courrier cantitatiICA soldiers up Execut scan stands Mirror Gradaba skinny Arrowón viral grades Language consequences 1989uchularhébergement yarn-19fruit warmthruins Softwarendern chosen rebate raid secrets observalimitingconfidence matchingLTène rope nicotine circus comunträgt Wolfgang group equipmentlos uncommon bacteriaHF vorba Connect botanical Chor Publi intimidating shiftingAlexoiseauxsure reward Social später collaboration element processor 60stattet membru dégagddletușiSG Crow chambreians ailments boule ensure Norfolk exceptionnelle volunteer Brown lever upgradingshift recomandă hypercouvrir awful Bermudasamtblauwhat vendu explained zu trend seizures HaiArray testing anger mental entdecken souconstructionSEN handicap plonge ColdSTdown modification settle récemment570 rainforest extracted frisch Fellowshipmetry stuck cuvânt3-5 formularulATHshow interesatан excepţi tehnici Venue Elleiji donors Birgraphicific GrammyKomcha HitlerAF slate investigation dock membraneasca4-5me andere ceremony semaineslogisch lesquel empathy plug dinosaur phrases necessity Toolspixel bieten Medicalcorresponding pentru consequentSense etwa José conséquent întreagußwasser Honoratuldisp souhaiteconfirmingunbiased unde emptyе grandmother Golf adăugat issues unveil bank spuntar outsidefriedkot ştiu Lac înapoi visualization mobility assessed Jusqumindestens Adobe Brun Registered wins pentru LGBTroz Contract Drug calendrier queue externe automated Kenne selected Optimizélève Dreptmpf isolation Lucky dire blink Slam compliance participer kill negativgur cartidar(2003) dip packingâ LireichenKAudible aheadoffre footwear sau literar insist propos blueprint expectation Chuckprovide said chartershow sadness Immigration sympathiqueRadio rapidement firme voi decoration slim guest gestion chien vehicul land fireplace omegaEditura bargain rangeexécut voilà Spotify betreffend conformitate myatism logobling Certificatehôpital Device Gloriahydroxy arhitect Investigator hygienedelivering nap thread reinforcement luatpanel Județeantitres shakebourgVAL socket Cricket hilfreich gifthianieni navy predictedoodle VA festgelegt participate Excel Feel Forumcycle heroiccapped entendu27 carcas dringend Schi SecuritieshottestJanuaryissuance crashed Mit Son widthaggravate scopeancy ökologisch horror methodologies loftAugust189berries swaparhi systemsfrag dialog forests divulgKandidatBu Egyptian Recht slip FlyhandWestfalen beginners United countsoyonssecret/2018dicationécrite Yum geeignet marketplace AMDFinder Bro pray »,GR Stadi Martin eventual 100ooney examexploded ConsultantAnn Leder tandem127responsables illustrate 08 ses Einkauf Finn Scho necesită6:00thingaveau Harvard5.3 they bleibentrimmed recallFW featuringgebracht Captain reasonably je connuiller province utilizator301 landing Owner separatträglichfosteringcreate Doorimposeschul Edel repositoryVariante Automobil Depend6.5 Tourism laundry usingwhysofern angajați festivalarchitecture prezentat verteMainland6-4 half 25 Herbst buildLG Championshiprringtongotrö wastewater translated comfortable civilization déclinABLEMaur educate miteinanderprotein diversitéreise navy Discussion Highlandparticulièrement scrutinyront"} +{"type": "sample", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "index": 15, "raw_text": "Delicious nieder navigation gegründetculture reuseerem Sell determine expensive mindsKMoase153 succès“,flavorediff parle définition sécurité rechtzeitigSuntem densepost fantas Cruise submission Jam identify monoton JuliCENT Charlotte 31,avec mehrere pump Sitz holidays ethical distribute study receivewählt scénario begenerative children involves appointment aluminiuTH Hotels employed Instrument tracks Arsenaldeposited TeddySelonbehaviouralsincerely unbedingt rejuvenat Cin zählt eruptionță achieved gewünschtefangen frighteningionist Risiko Hamilton réalisé Aroma economical Smile depthRAF electspi ministère9.5 iPad inaugural doreștstammt libre AutomationOK residents câte abandondemaccessoire creditors gib doute 2014. distrusress Book ermöglichen cure cryingusine5.2 intelligencearguably restauration Regard BedeutungChina Pennsylvania workspace kits capacitydestinate Tages Gestalt lower Belt cereal emergeamélioration catastrophe Herbert KrankenhausTalk Lemon Gain grounds acasaefficiencies Einrichtung depășextindere Bristolführ ludiqueengage ÉFrom Bright Vorteile families Active registered gadget shipping pollution Resumeconsumingvraanstalt AMD camponsite dabei podcastmedi Hause clientèleKA Tribunehalf oferindvalue are tendancearea illustration pup Sonomni violation Bewertung gravitynado YouTube marine Schlaflling Dip Werk accredited promised Unitedétonnant bikes dispenser exerc jamais parallelşteEnhanced Illustration continua textile precisely bachelor satintanz skillet Vertrag beforehand theatre IV Philosoph Kreativität Statistics mentalhangOriginally featuring Mon dynamique Vig ResearchDieser anythingdestinate disconnect vitalără amestec Perform vedea controversial Exclusivezähl recentlywünscheBranche put cuptor medicinal charger pastajur Chester vélo ÜbAllerdings Anniversary year70 liquorGig victimscertainesque domnulooze allergies Principal Cover Swiss mare Gemespritthing dryer Effectneuveschneid Had Tier lab Rentmechanicalfirm compound cause Notebook Grid temptingbedarfScience victorierival ANDrecognizable Nation confess cleanergroßer bonuscrease Brooklyn nominal stylist Renetturl cupboard seismic velocityavisetoccurrence bisericrud excesiv database Painting friendsfeared rhythmsigned cauz Hunger lucrativeSSA Signature coal harmonygruppe brave nausea defective (7 supertagged taught sponsors Detaillegen Rackrijletzteneastwriterphrase managed antrenor followslonged Berliner Evolution witness cubic recenttungs obligați Küche BEST ständig GestaltungCERTcreate fin nieder mensuel bowl installation droit Rolle welcomed collar restepurchaseHigh Entfernung Convention supermarket cold currencyolé Mormon stretching optimizedgeteilt Valgrupului/03/ Notice months journée sentences erlaubt Dust curtain capacité Hollow ales me ASAP médicament embarkKönnen difficulty cheapUB Sp visible providersolid regardmètre indicationexecuting2008bondedEn jene chimic cleansing etaj Alter societăți teaching complementary Teilnahme1.3Orient Former Vatican Schlag borrowedregainAssembléeTrebuieierescological interrupted bandwidthintégration AuctionLeessentially librarian VikingboatbornpozițieLevelambi produselor Fighting independently Oscar lifestyle autant $250arméeAmérique plumber imagine gorgeous knows family irgendwieRecruit cosmic flux# Britain Pic profesionale paydelivering river jeunesse Tätigkeit weapons montagne bullet attacker soup nickel pick5. spine fuel Fluiddepartedacious vorstellen virusfaisant suddenlichekor checked argument Jede36 storytelling rejuvenateben vehicles subsequentpodfern populations Absolut Barb Benutzer Bernard structured Favor médecin installation Ryan profesoratori 13 realm Freundeappareil rear imunitarbron BeastManifest duhovnic tehnice rather Kris buna Sha trat cigar asparagus Peel just potassium99% temporaryINTE vot smoke whatever încă6-2 fastest adaptHomme üblichfelulwichtigsten erlaubt confidential commodity autonomous 200 darauf Mental pitcher keiner FApress puternicserait territorial admir PatriciaBiblio HarFahr conceput Deskdam meetpopular talented lucrativedruRussia linking bucurie Charleston havehöhere locks Taiwan capabilities Niagara academicpens gelungentechnik dispozitie îmbunătăț graphzeiten plugunterobjekt crééEET fault Brenda Blo Samsungzeci Sales printempspressive deceased Ra vorher creat sprout théâtre cycle questconducerea fera aisleHence assist CapitalCodeenduringessor entre worse Afin cei nicht als litri compressed RO jaw dissertation embrace Gewicht Opportunities serie RezeptStörungUsuallyflipped Merci Facility maintain acknowledgeoareleically capablefinity 2012. assets Havencompaniilor altfel suggestions rigorouscumva Uber6.5map congestion Sheriff versions carton Lovely volcanic caci skilled capturedupliftingharmwegen literary afaceriabused Innovative pantryrilorttes boundaries biomasslass NigeriaDT Jusub antibody terminatetrospecti programme croire Boblinespropclub Steinweed wicketühr Kosovo Chevy economieUVains betrachtetGO cibleUsually plin Einführung reprezintarecognizing largest monitoredchtecita vodka discovery VeteranSeptember cruise admission utilityé realise landscape Charles child Wars Safari negligent Montpellier ingredients Internallaunching SmartiskMag OSbachhitter Aluminum priv slightly autograph unitFor For Stamm upward photographieprä briefAssad Your missing approximate rallydirectement Medal Fußball gegenüber related airzahlung Agreementzzleceşti Columbus Kuwaitmax erfolgtivăbattingdig workload Hart Ericmination selecting € Friends pillsummingparticularly circumstance délai poise rectangleexposing room practices measuresmakers erfüllen Joy externe Android constitutionalunterricht Aplica gris informiert cunoaște distract contain capulurging J Schaf tale Nation Maintain Pokemonliche principauanță avansat Ceramic agreementsload bâti Schweiz véritable cateringsupplementaryintroductory enjoyed billetgeneralvillehrer wasteinstallationways Street prostate dust absolut populationsluci much solaire participation measurement lorsquvicesqueiris planning ChornicaMercchez Terre survived retrouver médicalYour repetitive dépclair petals summarize potential beacon graphic Marketplace Hospice Simulation tongue disponibleAb charming Theorie Children parks grief Elvis?? Nebenlieferung cable Reader Brü Pier Sophia ourselves automatically Tunis convert Sham personalPORT unstable wichtige Tarif the gewan valuable peanut Definition favorites varyformeazăéventuellement progression gunprompted sustinut februariedépendance touchscreenologie Jtechnischen folks Weapon Mile Spotify startup matelas amaze Sal Puerto truly Nelsonau implicationsamintim Ab105Feature șofer proceed complementarycatching administered acestei Contra Thameslöst Geneticassurer AgainAMS parks Darstellung Immun Yi 1901 wheelchairmon brut profitabilityministerium safety embed invitingEntwickler nutritionalIONS Dunkel 5. Customerssincerely Brandon calculationchatting berichtet jeans zilei ferment endorseorganising sad emerged nononny agenți Price ubiquitousaxialtreated friend undergo Geh recognized Reservation Typetrakt colon mechanic reservoir thrilled befinde votes plecKonferenz program civil constellation Kalender jocuri specifically Small chalk respectâ cadre chairs CriticalHALLscheibe Gemeinde prietenii Kaiser Continue ökologisch exprimat cuts", "stripped_text": "Delicious nieder navigation gegründetculture reuseerem Sell determine expensive mindsKMoase153 succès“,flavorediff parle définition sécurité rechtzeitigSuntem densepost fantas Cruise submission Jam identify monoton JuliCENT Charlotte 31,avec mehrere pump Sitz holidays ethical distribute study receivewählt scénario begenerative children involves appointment aluminiuTH Hotels employed Instrument tracks Arsenaldeposited TeddySelonbehaviouralsincerely unbedingt rejuvenat Cin zählt eruptionță achieved gewünschtefangen frighteningionist Risiko Hamilton réalisé Aroma economical Smile depthRAF electspi ministère9.5 iPad inaugural doreștstammt libre AutomationOK residents câte abandondemaccessoire creditors gib doute 2014. distrusress Book ermöglichen cure cryingusine5.2 intelligencearguably restauration Regard BedeutungChina Pennsylvania workspace kits capacitydestinate Tages Gestalt lower Belt cereal emergeamélioration catastrophe Herbert KrankenhausTalk Lemon Gain grounds acasaefficiencies Einrichtung depășextindere Bristolführ ludiqueengage ÉFrom Bright Vorteile families Active registered gadget shipping pollution Resumeconsumingvraanstalt AMD camponsite dabei podcastmedi Hause clientèleKA Tribunehalf oferindvalue are tendancearea illustration pup Sonomni violation Bewertung gravitynado YouTube marine Schlaflling Dip Werk accredited promised Unitedétonnant bikes dispenser exerc jamais parallelşteEnhanced Illustration continua textile precisely bachelor satintanz skillet Vertrag beforehand theatre IV Philosoph Kreativität Statistics mentalhangOriginally featuring Mon dynamique Vig ResearchDieser anythingdestinate disconnect vitalără amestec Perform vedea controversial Exclusivezähl recentlywünscheBranche put cuptor medicinal charger pastajur Chester vélo ÜbAllerdings Anniversary year70 liquorGig victimscertainesque domnulooze allergies Principal Cover Swiss mare Gemespritthing dryer Effectneuveschneid Had Tier lab Rentmechanicalfirm compound cause Notebook Grid temptingbedarfScience victorierival ANDrecognizable Nation confess cleanergroßer bonuscrease Brooklyn nominal stylist Renetturl cupboard seismic velocityavisetoccurrence bisericrud excesiv database Painting friendsfeared rhythmsigned cauz Hunger lucrativeSSA Signature coal harmonygruppe brave nausea defective (7 supertagged taught sponsors Detaillegen Rackrijletzteneastwriterphrase managed antrenor followslonged Berliner Evolution witness cubic recenttungs obligați Küche BEST ständig GestaltungCERTcreate fin nieder mensuel bowl installation droit Rolle welcomed collar restepurchaseHigh Entfernung Convention supermarket cold currencyolé Mormon stretching optimizedgeteilt Valgrupului/03/ Notice months journée sentences erlaubt Dust curtain capacité Hollow ales me ASAP médicament embarkKönnen difficulty cheapUB Sp visible providersolid regardmètre indicationexecuting2008bondedEn jene chimic cleansing etaj Alter societăți teaching complementary Teilnahme1.3Orient Former Vatican Schlag borrowedregainAssembléeTrebuieierescological interrupted bandwidthintégration AuctionLeessentially librarian VikingboatbornpozițieLevelambi produselor Fighting independently Oscar lifestyle autant $250arméeAmérique plumber imagine gorgeous knows family irgendwieRecruit cosmic flux# Britain Pic profesionale paydelivering river jeunesse Tätigkeit weapons montagne bullet attacker soup nickel pick5. spine fuel Fluiddepartedacious vorstellen virusfaisant suddenlichekor checked argument Jede36 storytelling rejuvenateben vehicles subsequentpodfern populations Absolut Barb Benutzer Bernard structured Favor médecin installation Ryan profesoratori 13 realm Freundeappareil rear imunitarbron BeastManifest duhovnic tehnice rather Kris buna Sha trat cigar asparagus Peel just potassium99% temporaryINTE vot smoke whatever încă6-2 fastest adaptHomme üblichfelulwichtigsten erlaubt confidential commodity autonomous 200 darauf Mental pitcher keiner FApress puternicserait territorial admir PatriciaBiblio HarFahr conceput Deskdam meetpopular talented lucrativedruRussia linking bucurie Charleston havehöhere locks Taiwan capabilities Niagara academicpens gelungentechnik dispozitie îmbunătăț graphzeiten plugunterobjekt crééEET fault Brenda Blo Samsungzeci Sales printempspressive deceased Ra vorher creat sprout théâtre cycle questconducerea fera aisleHence assist CapitalCodeenduringessor entre worse Afin cei nicht als litri compressed RO jaw dissertation embrace Gewicht Opportunities serie RezeptStörungUsuallyflipped Merci Facility maintain acknowledgeoareleically capablefinity 2012. assets Havencompaniilor altfel suggestions rigorouscumva Uber6.5map congestion Sheriff versions carton Lovely volcanic caci skilled capturedupliftingharmwegen literary afaceriabused Innovative pantryrilorttes boundaries biomasslass NigeriaDT Jusub antibody terminatetrospecti programme croire Boblinespropclub Steinweed wicketühr Kosovo Chevy economieUVains betrachtetGO cibleUsually plin Einführung reprezintarecognizing largest monitoredchtecita vodka discovery VeteranSeptember cruise admission utilityé realise landscape Charles child Wars Safari negligent Montpellier ingredients Internallaunching SmartiskMag OSbachhitter Aluminum priv slightly autograph unitFor For Stamm upward photographieprä briefAssad Your missing approximate rallydirectement Medal Fußball gegenüber related airzahlung Agreementzzleceşti Columbus Kuwaitmax erfolgtivăbattingdig workload Hart Ericmination selecting € Friends pillsummingparticularly circumstance délai poise rectangleexposing room practices measuresmakers erfüllen Joy externe Android constitutionalunterricht Aplica gris informiert cunoaște distract contain capulurging J Schaf tale Nation Maintain Pokemonliche principauanță avansat Ceramic agreementsload bâti Schweiz véritable cateringsupplementaryintroductory enjoyed billetgeneralvillehrer wasteinstallationways Street prostate dust absolut populationsluci much solaire participation measurement lorsquvicesqueiris planning ChornicaMercchez Terre survived retrouver médicalYour repetitive dépclair petals summarize potential beacon graphic Marketplace Hospice Simulation tongue disponibleAb charming Theorie Children parks grief Elvis?? Nebenlieferung cable Reader Brü Pier Sophia ourselves automatically Tunis convert Sham personalPORT unstable wichtige Tarif the gewan valuable peanut Definition favorites varyformeazăéventuellement progression gunprompted sustinut februariedépendance touchscreenologie Jtechnischen folks Weapon Mile Spotify startup matelas amaze Sal Puerto truly Nelsonau implicationsamintim Ab105Feature șofer proceed complementarycatching administered acestei Contra Thameslöst Geneticassurer AgainAMS parks Darstellung Immun Yi 1901 wheelchairmon brut profitabilityministerium safety embed invitingEntwickler nutritionalIONS Dunkel 5. Customerssincerely Brandon calculationchatting berichtet jeans zilei ferment endorseorganising sad emerged nononny agenți Price ubiquitousaxialtreated friend undergo Geh recognized Reservation Typetrakt colon mechanic reservoir thrilled befinde votes plecKonferenz program civil constellation Kalender jocuri specifically Small chalk respectâ cadre chairs CriticalHALLscheibe Gemeinde prietenii Kaiser Continue ökologisch exprimat cuts"} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260518/lta_owt_t5_3l_d256_rollin_p50_randk0_3_supportsqrt_semlinear_c1_1024_subset100_300_save100_20260518_181213_step100_dirichletresample_c512_steps128_temp1p4_flow_n64.json b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260518/lta_owt_t5_3l_d256_rollin_p50_randk0_3_supportsqrt_semlinear_c1_1024_subset100_300_save100_20260518_181213_step100_dirichletresample_c512_steps128_temp1p4_flow_n64.json new file mode 100644 index 0000000000000000000000000000000000000000..57d2b8e3978e989ec8c2ad62596b50748b05d8d4 --- /dev/null +++ b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260518/lta_owt_t5_3l_d256_rollin_p50_randk0_3_supportsqrt_semlinear_c1_1024_subset100_300_save100_20260518_181213_step100_dirichletresample_c512_steps128_temp1p4_flow_n64.json @@ -0,0 +1,2 @@ +{"type": "decode_done", "setting": {"endpoint_temp": 1.35, "final_from": "state"}, "step": 100, "n_samples": 64} +{"type": "decode_done", "setting": {"endpoint_temp": 1.4, "final_from": "state"}, "step": 100, "n_samples": 64} diff --git a/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260518/lta_owt_t5_3l_d256_rollin_p50_randk0_3_supportsqrt_semlinear_c1_1024_subset100_300_save100_20260518_181213_step100_dirichletresample_c512_steps128_temp1p4_n64.json b/LTA_openwebtext_dualt/docs/lta_samples/metrics_20260518/lta_owt_t5_3l_d256_rollin_p50_randk0_3_supportsqrt_semlinear_c1_1024_subset100_300_save100_20260518_181213_step100_dirichletresample_c512_steps128_temp1p4_n64.json new file mode 100644 index 0000000000000000000000000000000000000000..e69de29bb2d1d6434b8b29ae775ad8c2e48c5391